2023-03-14 14:52:54,552 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor timeout: 13 mins 2023-03-14 14:52:54,785 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/32713c79-3a0d-e28f-4850-1b932c385dc5 2023-03-14 14:52:54,796 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=1, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-03-14 14:52:54,797 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/32713c79-3a0d-e28f-4850-1b932c385dc5/cluster_ea1a76c9-5fcc-f1b0-725a-f88680cff8ea, deleteOnExit=true 2023-03-14 14:52:54,797 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-03-14 14:52:54,798 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/32713c79-3a0d-e28f-4850-1b932c385dc5/test.cache.data in system properties and HBase conf 2023-03-14 14:52:54,798 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/32713c79-3a0d-e28f-4850-1b932c385dc5/hadoop.tmp.dir in system properties and HBase conf 2023-03-14 14:52:54,798 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/32713c79-3a0d-e28f-4850-1b932c385dc5/hadoop.log.dir in system properties and HBase conf 2023-03-14 14:52:54,799 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/32713c79-3a0d-e28f-4850-1b932c385dc5/mapreduce.cluster.local.dir in system properties and HBase conf 2023-03-14 14:52:54,799 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/32713c79-3a0d-e28f-4850-1b932c385dc5/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-03-14 14:52:54,800 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-03-14 14:52:54,913 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-03-14 14:52:55,269 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-03-14 14:52:55,273 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/32713c79-3a0d-e28f-4850-1b932c385dc5/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-03-14 14:52:55,274 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/32713c79-3a0d-e28f-4850-1b932c385dc5/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-03-14 14:52:55,274 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/32713c79-3a0d-e28f-4850-1b932c385dc5/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-03-14 14:52:55,274 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/32713c79-3a0d-e28f-4850-1b932c385dc5/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-03-14 14:52:55,275 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/32713c79-3a0d-e28f-4850-1b932c385dc5/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-03-14 14:52:55,275 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/32713c79-3a0d-e28f-4850-1b932c385dc5/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-03-14 14:52:55,275 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/32713c79-3a0d-e28f-4850-1b932c385dc5/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-03-14 14:52:55,276 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/32713c79-3a0d-e28f-4850-1b932c385dc5/dfs.journalnode.edits.dir in system properties and HBase conf 2023-03-14 14:52:55,276 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/32713c79-3a0d-e28f-4850-1b932c385dc5/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-03-14 14:52:55,276 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/32713c79-3a0d-e28f-4850-1b932c385dc5/nfs.dump.dir in system properties and HBase conf 2023-03-14 14:52:55,277 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/32713c79-3a0d-e28f-4850-1b932c385dc5/java.io.tmpdir in system properties and HBase conf 2023-03-14 14:52:55,277 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/32713c79-3a0d-e28f-4850-1b932c385dc5/dfs.journalnode.edits.dir in system properties and HBase conf 2023-03-14 14:52:55,278 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/32713c79-3a0d-e28f-4850-1b932c385dc5/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-03-14 14:52:55,278 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/32713c79-3a0d-e28f-4850-1b932c385dc5/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-03-14 14:52:55,808 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-03-14 14:52:55,812 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-03-14 14:52:56,080 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-03-14 14:52:56,294 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-03-14 14:52:56,315 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-03-14 14:52:56,353 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-03-14 14:52:56,386 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/32713c79-3a0d-e28f-4850-1b932c385dc5/java.io.tmpdir/Jetty_localhost_localdomain_38657_hdfs____jfrcfh/webapp 2023-03-14 14:52:56,532 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:38657 2023-03-14 14:52:56,574 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-03-14 14:52:56,574 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-03-14 14:52:57,183 WARN [Listener at localhost.localdomain/33945] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-03-14 14:52:57,332 WARN [Listener at localhost.localdomain/33945] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-03-14 14:52:57,353 WARN [Listener at localhost.localdomain/33945] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-03-14 14:52:57,361 INFO [Listener at localhost.localdomain/33945] log.Slf4jLog(67): jetty-6.1.26 2023-03-14 14:52:57,375 INFO [Listener at localhost.localdomain/33945] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/32713c79-3a0d-e28f-4850-1b932c385dc5/java.io.tmpdir/Jetty_localhost_36245_datanode____3ad6fr/webapp 2023-03-14 14:52:57,507 INFO [Listener at localhost.localdomain/33945] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36245 2023-03-14 14:52:58,058 WARN [Listener at localhost.localdomain/44261] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-03-14 14:52:58,639 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x60f96ad25a27b1d5: Processing first storage report for DS-93b8f615-df9b-487f-99e0-1dfca1abfab3 from datanode 9781bc52-66f5-49e1-bb4e-a435e13d0b1c 2023-03-14 14:52:58,641 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x60f96ad25a27b1d5: from storage DS-93b8f615-df9b-487f-99e0-1dfca1abfab3 node DatanodeRegistration(127.0.0.1:44499, datanodeUuid=9781bc52-66f5-49e1-bb4e-a435e13d0b1c, infoPort=41833, infoSecurePort=0, ipcPort=44261, storageInfo=lv=-57;cid=testClusterID;nsid=1751010000;c=1678805575875), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-03-14 14:52:58,641 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x60f96ad25a27b1d5: Processing first storage report for DS-e05e4cc5-9d59-4bc4-903e-b523a6ef52e9 from datanode 9781bc52-66f5-49e1-bb4e-a435e13d0b1c 2023-03-14 14:52:58,641 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x60f96ad25a27b1d5: from storage DS-e05e4cc5-9d59-4bc4-903e-b523a6ef52e9 node DatanodeRegistration(127.0.0.1:44499, datanodeUuid=9781bc52-66f5-49e1-bb4e-a435e13d0b1c, infoPort=41833, infoSecurePort=0, ipcPort=44261, storageInfo=lv=-57;cid=testClusterID;nsid=1751010000;c=1678805575875), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-03-14 14:52:58,722 DEBUG [Listener at localhost.localdomain/44261] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/32713c79-3a0d-e28f-4850-1b932c385dc5 2023-03-14 14:52:58,794 INFO [Listener at localhost.localdomain/44261] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/32713c79-3a0d-e28f-4850-1b932c385dc5/cluster_ea1a76c9-5fcc-f1b0-725a-f88680cff8ea/zookeeper_0, clientPort=50211, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/32713c79-3a0d-e28f-4850-1b932c385dc5/cluster_ea1a76c9-5fcc-f1b0-725a-f88680cff8ea/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/32713c79-3a0d-e28f-4850-1b932c385dc5/cluster_ea1a76c9-5fcc-f1b0-725a-f88680cff8ea/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-03-14 14:52:58,810 INFO [Listener at localhost.localdomain/44261] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=50211 2023-03-14 14:52:58,817 INFO [Listener at localhost.localdomain/44261] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-14 14:52:58,819 INFO [Listener at localhost.localdomain/44261] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-14 14:52:59,539 INFO [Listener at localhost.localdomain/44261] util.FSUtils(471): Created version file at hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd with version=8 2023-03-14 14:52:59,540 INFO [Listener at localhost.localdomain/44261] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/hbase-staging 2023-03-14 14:52:59,841 INFO [Listener at localhost.localdomain/44261] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-03-14 14:53:00,306 INFO [Listener at localhost.localdomain/44261] client.ConnectionUtils(127): master/jenkins-hbase20:0 server-side Connection retries=3 2023-03-14 14:53:00,335 INFO [Listener at localhost.localdomain/44261] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-03-14 14:53:00,336 INFO [Listener at localhost.localdomain/44261] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-03-14 14:53:00,336 INFO [Listener at localhost.localdomain/44261] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-03-14 14:53:00,336 INFO [Listener at localhost.localdomain/44261] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-03-14 14:53:00,336 INFO [Listener at localhost.localdomain/44261] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-03-14 14:53:00,489 INFO [Listener at localhost.localdomain/44261] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-03-14 14:53:00,553 DEBUG [Listener at localhost.localdomain/44261] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-03-14 14:53:00,632 INFO [Listener at localhost.localdomain/44261] ipc.NettyRpcServer(120): Bind to /148.251.75.209:38031 2023-03-14 14:53:00,641 INFO [Listener at localhost.localdomain/44261] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-14 14:53:00,643 INFO [Listener at localhost.localdomain/44261] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-14 14:53:00,661 INFO [Listener at localhost.localdomain/44261] zookeeper.RecoverableZooKeeper(93): Process identifier=master:38031 connecting to ZooKeeper ensemble=127.0.0.1:50211 2023-03-14 14:53:00,696 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:380310x0, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-03-14 14:53:00,699 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:38031-0x10010524c470000 connected 2023-03-14 14:53:00,760 DEBUG [Listener at localhost.localdomain/44261] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-03-14 14:53:00,761 DEBUG [Listener at localhost.localdomain/44261] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-03-14 14:53:00,764 DEBUG [Listener at localhost.localdomain/44261] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-03-14 14:53:00,771 DEBUG [Listener at localhost.localdomain/44261] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38031 2023-03-14 14:53:00,772 DEBUG [Listener at localhost.localdomain/44261] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38031 2023-03-14 14:53:00,772 DEBUG [Listener at localhost.localdomain/44261] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38031 2023-03-14 14:53:00,774 DEBUG [Listener at localhost.localdomain/44261] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38031 2023-03-14 14:53:00,778 DEBUG [Listener at localhost.localdomain/44261] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38031 2023-03-14 14:53:00,783 INFO [Listener at localhost.localdomain/44261] master.HMaster(444): hbase.rootdir=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd, hbase.cluster.distributed=false 2023-03-14 14:53:00,878 INFO [Listener at localhost.localdomain/44261] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=3 2023-03-14 14:53:00,879 INFO [Listener at localhost.localdomain/44261] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-03-14 14:53:00,879 INFO [Listener at localhost.localdomain/44261] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-03-14 14:53:00,879 INFO [Listener at localhost.localdomain/44261] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-03-14 14:53:00,879 INFO [Listener at localhost.localdomain/44261] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-03-14 14:53:00,879 INFO [Listener at localhost.localdomain/44261] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-03-14 14:53:00,885 INFO [Listener at localhost.localdomain/44261] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-03-14 14:53:00,889 INFO [Listener at localhost.localdomain/44261] ipc.NettyRpcServer(120): Bind to /148.251.75.209:41317 2023-03-14 14:53:00,892 INFO [Listener at localhost.localdomain/44261] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-03-14 14:53:00,899 DEBUG [Listener at localhost.localdomain/44261] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-03-14 14:53:00,900 INFO [Listener at localhost.localdomain/44261] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-14 14:53:00,904 INFO [Listener at localhost.localdomain/44261] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-14 14:53:00,906 INFO [Listener at localhost.localdomain/44261] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41317 connecting to ZooKeeper ensemble=127.0.0.1:50211 2023-03-14 14:53:00,910 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:413170x0, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-03-14 14:53:00,911 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:41317-0x10010524c470001 connected 2023-03-14 14:53:00,912 DEBUG [Listener at localhost.localdomain/44261] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-03-14 14:53:00,913 DEBUG [Listener at localhost.localdomain/44261] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-03-14 14:53:00,914 DEBUG [Listener at localhost.localdomain/44261] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-03-14 14:53:00,920 DEBUG [Listener at localhost.localdomain/44261] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41317 2023-03-14 14:53:00,921 DEBUG [Listener at localhost.localdomain/44261] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41317 2023-03-14 14:53:00,921 DEBUG [Listener at localhost.localdomain/44261] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41317 2023-03-14 14:53:00,922 DEBUG [Listener at localhost.localdomain/44261] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41317 2023-03-14 14:53:00,924 DEBUG [Listener at localhost.localdomain/44261] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41317 2023-03-14 14:53:00,929 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase20.apache.org,38031,1678805579674 2023-03-14 14:53:00,937 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-03-14 14:53:00,939 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase20.apache.org,38031,1678805579674 2023-03-14 14:53:00,962 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-03-14 14:53:00,962 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-03-14 14:53:00,962 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-14 14:53:00,963 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-03-14 14:53:00,964 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase20.apache.org,38031,1678805579674 from backup master directory 2023-03-14 14:53:00,964 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-03-14 14:53:00,967 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase20.apache.org,38031,1678805579674 2023-03-14 14:53:00,967 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-03-14 14:53:00,968 WARN [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-03-14 14:53:00,968 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase20.apache.org,38031,1678805579674 2023-03-14 14:53:00,971 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-03-14 14:53:00,973 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-03-14 14:53:01,471 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/hbase.id with ID: 38644475-a955-4b11-9f8b-905034e82a06 2023-03-14 14:53:01,515 INFO [master/jenkins-hbase20:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-14 14:53:01,531 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-14 14:53:01,973 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x16fac52d to 127.0.0.1:50211 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-14 14:53:02,008 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6267c788, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-14 14:53:02,031 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-03-14 14:53:02,034 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-03-14 14:53:02,052 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-03-14 14:53:02,052 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-03-14 14:53:02,054 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-03-14 14:53:02,058 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-03-14 14:53:02,059 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-03-14 14:53:02,095 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/MasterData/data/master/store-tmp 2023-03-14 14:53:02,537 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 14:53:02,537 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-03-14 14:53:02,537 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-14 14:53:02,537 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-14 14:53:02,537 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-03-14 14:53:02,538 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-14 14:53:02,538 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-14 14:53:02,538 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-03-14 14:53:02,540 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/MasterData/WALs/jenkins-hbase20.apache.org,38031,1678805579674 2023-03-14 14:53:02,562 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C38031%2C1678805579674, suffix=, logDir=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/MasterData/WALs/jenkins-hbase20.apache.org,38031,1678805579674, archiveDir=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/MasterData/oldWALs, maxLogs=10 2023-03-14 14:53:02,614 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44499,DS-93b8f615-df9b-487f-99e0-1dfca1abfab3,DISK] 2023-03-14 14:53:02,624 DEBUG [RS-EventLoopGroup-3-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-03-14 14:53:02,688 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/MasterData/WALs/jenkins-hbase20.apache.org,38031,1678805579674/jenkins-hbase20.apache.org%2C38031%2C1678805579674.1678805582571 2023-03-14 14:53:02,692 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44499,DS-93b8f615-df9b-487f-99e0-1dfca1abfab3,DISK]] 2023-03-14 14:53:02,693 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-03-14 14:53:02,693 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 14:53:02,697 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-03-14 14:53:02,699 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-03-14 14:53:02,775 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-03-14 14:53:02,782 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-03-14 14:53:02,812 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-03-14 14:53:02,850 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 14:53:02,856 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-03-14 14:53:02,858 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-03-14 14:53:02,875 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-03-14 14:53:02,879 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-14 14:53:02,880 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60537139, jitterRate=-0.09792633354663849}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-14 14:53:02,881 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-03-14 14:53:02,882 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-03-14 14:53:02,900 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-03-14 14:53:02,901 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-03-14 14:53:02,903 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-03-14 14:53:02,904 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-03-14 14:53:02,932 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 27 msec 2023-03-14 14:53:02,932 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-03-14 14:53:02,955 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-03-14 14:53:02,960 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-03-14 14:53:02,987 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-03-14 14:53:02,992 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-03-14 14:53:02,994 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-03-14 14:53:03,001 INFO [master/jenkins-hbase20:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-03-14 14:53:03,006 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-03-14 14:53:03,008 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-14 14:53:03,009 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-03-14 14:53:03,010 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-03-14 14:53:03,024 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-03-14 14:53:03,029 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-03-14 14:53:03,029 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-03-14 14:53:03,029 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-14 14:53:03,030 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase20.apache.org,38031,1678805579674, sessionid=0x10010524c470000, setting cluster-up flag (Was=false) 2023-03-14 14:53:03,045 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-14 14:53:03,048 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-03-14 14:53:03,050 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,38031,1678805579674 2023-03-14 14:53:03,065 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-14 14:53:03,068 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-03-14 14:53:03,070 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,38031,1678805579674 2023-03-14 14:53:03,072 WARN [master/jenkins-hbase20:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.hbase-snapshot/.tmp 2023-03-14 14:53:03,132 INFO [RS:0;jenkins-hbase20:41317] regionserver.HRegionServer(952): ClusterId : 38644475-a955-4b11-9f8b-905034e82a06 2023-03-14 14:53:03,137 DEBUG [RS:0;jenkins-hbase20:41317] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-03-14 14:53:03,142 DEBUG [RS:0;jenkins-hbase20:41317] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-03-14 14:53:03,142 DEBUG [RS:0;jenkins-hbase20:41317] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-03-14 14:53:03,146 DEBUG [RS:0;jenkins-hbase20:41317] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-03-14 14:53:03,147 DEBUG [RS:0;jenkins-hbase20:41317] zookeeper.ReadOnlyZKClient(139): Connect 0x2eff5db8 to 127.0.0.1:50211 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-14 14:53:03,164 DEBUG [RS:0;jenkins-hbase20:41317] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2038a617, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-14 14:53:03,165 DEBUG [RS:0;jenkins-hbase20:41317] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@240736c8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-03-14 14:53:03,195 DEBUG [RS:0;jenkins-hbase20:41317] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase20:41317 2023-03-14 14:53:03,200 INFO [RS:0;jenkins-hbase20:41317] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-03-14 14:53:03,200 INFO [RS:0;jenkins-hbase20:41317] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-03-14 14:53:03,200 DEBUG [RS:0;jenkins-hbase20:41317] regionserver.HRegionServer(1023): About to register with Master. 2023-03-14 14:53:03,203 INFO [RS:0;jenkins-hbase20:41317] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase20.apache.org,38031,1678805579674 with isa=jenkins-hbase20.apache.org/148.251.75.209:41317, startcode=1678805580877 2023-03-14 14:53:03,216 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-03-14 14:53:03,221 DEBUG [RS:0;jenkins-hbase20:41317] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-03-14 14:53:03,227 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-03-14 14:53:03,227 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-03-14 14:53:03,227 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-03-14 14:53:03,227 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-03-14 14:53:03,227 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase20:0, corePoolSize=10, maxPoolSize=10 2023-03-14 14:53:03,227 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-03-14 14:53:03,228 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-03-14 14:53:03,228 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-03-14 14:53:03,234 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1678805613234 2023-03-14 14:53:03,237 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-03-14 14:53:03,238 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-03-14 14:53:03,239 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-03-14 14:53:03,244 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-03-14 14:53:03,264 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-03-14 14:53:03,271 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-03-14 14:53:03,272 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-03-14 14:53:03,272 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-03-14 14:53:03,272 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-03-14 14:53:03,274 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-03-14 14:53:03,279 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-03-14 14:53:03,283 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-03-14 14:53:03,284 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-03-14 14:53:03,294 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-03-14 14:53:03,295 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-03-14 14:53:03,299 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:40819, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-03-14 14:53:03,299 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1678805583297,5,FailOnTimeoutGroup] 2023-03-14 14:53:03,301 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-03-14 14:53:03,302 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-03-14 14:53:03,303 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd 2023-03-14 14:53:03,306 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1678805583300,5,FailOnTimeoutGroup] 2023-03-14 14:53:03,306 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-03-14 14:53:03,307 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-03-14 14:53:03,308 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-03-14 14:53:03,309 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-03-14 14:53:03,320 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:03,338 DEBUG [RS:0;jenkins-hbase20:41317] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd 2023-03-14 14:53:03,338 DEBUG [RS:0;jenkins-hbase20:41317] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost.localdomain:33945 2023-03-14 14:53:03,338 DEBUG [RS:0;jenkins-hbase20:41317] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-03-14 14:53:03,343 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-03-14 14:53:03,344 DEBUG [RS:0;jenkins-hbase20:41317] zookeeper.ZKUtil(162): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:03,344 WARN [RS:0;jenkins-hbase20:41317] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-03-14 14:53:03,345 INFO [RS:0;jenkins-hbase20:41317] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-03-14 14:53:03,345 DEBUG [RS:0;jenkins-hbase20:41317] regionserver.HRegionServer(1947): logDir=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/WALs/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:03,346 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,41317,1678805580877] 2023-03-14 14:53:03,355 DEBUG [RS:0;jenkins-hbase20:41317] zookeeper.ZKUtil(162): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:03,367 DEBUG [RS:0;jenkins-hbase20:41317] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-03-14 14:53:03,376 INFO [RS:0;jenkins-hbase20:41317] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-03-14 14:53:03,396 INFO [RS:0;jenkins-hbase20:41317] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-03-14 14:53:03,399 INFO [RS:0;jenkins-hbase20:41317] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-14 14:53:03,399 INFO [RS:0;jenkins-hbase20:41317] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-14 14:53:03,400 INFO [RS:0;jenkins-hbase20:41317] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-03-14 14:53:03,407 INFO [RS:0;jenkins-hbase20:41317] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=100, unit=MILLISECONDS is enabled. 2023-03-14 14:53:03,408 DEBUG [RS:0;jenkins-hbase20:41317] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-03-14 14:53:03,408 DEBUG [RS:0;jenkins-hbase20:41317] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-03-14 14:53:03,408 DEBUG [RS:0;jenkins-hbase20:41317] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-03-14 14:53:03,408 DEBUG [RS:0;jenkins-hbase20:41317] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-03-14 14:53:03,409 DEBUG [RS:0;jenkins-hbase20:41317] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-03-14 14:53:03,409 DEBUG [RS:0;jenkins-hbase20:41317] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-03-14 14:53:03,409 DEBUG [RS:0;jenkins-hbase20:41317] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-03-14 14:53:03,409 DEBUG [RS:0;jenkins-hbase20:41317] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-03-14 14:53:03,409 DEBUG [RS:0;jenkins-hbase20:41317] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-03-14 14:53:03,409 DEBUG [RS:0;jenkins-hbase20:41317] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-03-14 14:53:03,410 INFO [RS:0;jenkins-hbase20:41317] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-03-14 14:53:03,410 INFO [RS:0;jenkins-hbase20:41317] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-03-14 14:53:03,410 INFO [RS:0;jenkins-hbase20:41317] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-03-14 14:53:03,425 INFO [RS:0;jenkins-hbase20:41317] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-03-14 14:53:03,427 INFO [RS:0;jenkins-hbase20:41317] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,41317,1678805580877-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-03-14 14:53:03,441 INFO [RS:0;jenkins-hbase20:41317] regionserver.Replication(203): jenkins-hbase20.apache.org,41317,1678805580877 started 2023-03-14 14:53:03,441 INFO [RS:0;jenkins-hbase20:41317] regionserver.HRegionServer(1638): Serving as jenkins-hbase20.apache.org,41317,1678805580877, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:41317, sessionid=0x10010524c470001 2023-03-14 14:53:03,442 DEBUG [RS:0;jenkins-hbase20:41317] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-03-14 14:53:03,442 DEBUG [RS:0;jenkins-hbase20:41317] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:03,442 DEBUG [RS:0;jenkins-hbase20:41317] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,41317,1678805580877' 2023-03-14 14:53:03,442 DEBUG [RS:0;jenkins-hbase20:41317] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:53:03,442 DEBUG [RS:0;jenkins-hbase20:41317] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:53:03,443 DEBUG [RS:0;jenkins-hbase20:41317] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-03-14 14:53:03,443 DEBUG [RS:0;jenkins-hbase20:41317] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-03-14 14:53:03,443 DEBUG [RS:0;jenkins-hbase20:41317] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:03,443 DEBUG [RS:0;jenkins-hbase20:41317] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,41317,1678805580877' 2023-03-14 14:53:03,443 DEBUG [RS:0;jenkins-hbase20:41317] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-03-14 14:53:03,443 DEBUG [RS:0;jenkins-hbase20:41317] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-03-14 14:53:03,444 DEBUG [RS:0;jenkins-hbase20:41317] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-03-14 14:53:03,444 INFO [RS:0;jenkins-hbase20:41317] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-03-14 14:53:03,444 INFO [RS:0;jenkins-hbase20:41317] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-03-14 14:53:03,553 INFO [RS:0;jenkins-hbase20:41317] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C41317%2C1678805580877, suffix=, logDir=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/WALs/jenkins-hbase20.apache.org,41317,1678805580877, archiveDir=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/oldWALs, maxLogs=32 2023-03-14 14:53:03,575 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44499,DS-93b8f615-df9b-487f-99e0-1dfca1abfab3,DISK] 2023-03-14 14:53:03,579 INFO [RS:0;jenkins-hbase20:41317] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/WALs/jenkins-hbase20.apache.org,41317,1678805580877/jenkins-hbase20.apache.org%2C41317%2C1678805580877.1678805583556 2023-03-14 14:53:03,579 DEBUG [RS:0;jenkins-hbase20:41317] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44499,DS-93b8f615-df9b-487f-99e0-1dfca1abfab3,DISK]] 2023-03-14 14:53:03,726 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 14:53:03,729 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-03-14 14:53:03,732 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/hbase/meta/1588230740/info 2023-03-14 14:53:03,733 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-03-14 14:53:03,734 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 14:53:03,735 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-03-14 14:53:03,737 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/hbase/meta/1588230740/rep_barrier 2023-03-14 14:53:03,738 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-03-14 14:53:03,739 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 14:53:03,739 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-03-14 14:53:03,742 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/hbase/meta/1588230740/table 2023-03-14 14:53:03,742 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-03-14 14:53:03,743 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 14:53:03,745 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/hbase/meta/1588230740 2023-03-14 14:53:03,746 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/hbase/meta/1588230740 2023-03-14 14:53:03,750 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-03-14 14:53:03,751 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-03-14 14:53:03,755 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-14 14:53:03,756 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74327445, jitterRate=0.10756523907184601}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-03-14 14:53:03,756 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-03-14 14:53:03,756 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-03-14 14:53:03,756 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-03-14 14:53:03,756 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-03-14 14:53:03,756 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-03-14 14:53:03,756 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-03-14 14:53:03,758 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-03-14 14:53:03,758 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-03-14 14:53:03,762 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-03-14 14:53:03,762 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-03-14 14:53:03,769 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-03-14 14:53:03,779 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-03-14 14:53:03,781 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-03-14 14:53:03,933 DEBUG [jenkins-hbase20:38031] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-03-14 14:53:03,936 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,41317,1678805580877, state=OPENING 2023-03-14 14:53:03,942 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-03-14 14:53:03,943 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-14 14:53:03,943 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-03-14 14:53:03,945 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,41317,1678805580877}] 2023-03-14 14:53:04,125 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:04,127 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-03-14 14:53:04,131 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:40790, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-03-14 14:53:04,143 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-03-14 14:53:04,143 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-03-14 14:53:04,147 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C41317%2C1678805580877.meta, suffix=.meta, logDir=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/WALs/jenkins-hbase20.apache.org,41317,1678805580877, archiveDir=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/oldWALs, maxLogs=32 2023-03-14 14:53:04,164 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44499,DS-93b8f615-df9b-487f-99e0-1dfca1abfab3,DISK] 2023-03-14 14:53:04,178 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/WALs/jenkins-hbase20.apache.org,41317,1678805580877/jenkins-hbase20.apache.org%2C41317%2C1678805580877.meta.1678805584149.meta 2023-03-14 14:53:04,179 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44499,DS-93b8f615-df9b-487f-99e0-1dfca1abfab3,DISK]] 2023-03-14 14:53:04,179 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-03-14 14:53:04,181 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-03-14 14:53:04,194 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-03-14 14:53:04,198 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-03-14 14:53:04,202 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-03-14 14:53:04,202 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 14:53:04,203 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-03-14 14:53:04,203 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-03-14 14:53:04,205 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-03-14 14:53:04,207 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/hbase/meta/1588230740/info 2023-03-14 14:53:04,207 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/hbase/meta/1588230740/info 2023-03-14 14:53:04,208 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-03-14 14:53:04,209 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 14:53:04,210 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-03-14 14:53:04,211 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/hbase/meta/1588230740/rep_barrier 2023-03-14 14:53:04,211 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/hbase/meta/1588230740/rep_barrier 2023-03-14 14:53:04,213 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-03-14 14:53:04,214 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 14:53:04,214 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-03-14 14:53:04,216 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/hbase/meta/1588230740/table 2023-03-14 14:53:04,216 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/hbase/meta/1588230740/table 2023-03-14 14:53:04,216 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-03-14 14:53:04,217 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 14:53:04,219 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/hbase/meta/1588230740 2023-03-14 14:53:04,222 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/hbase/meta/1588230740 2023-03-14 14:53:04,225 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-03-14 14:53:04,227 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-03-14 14:53:04,229 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60643350, jitterRate=-0.09634366631507874}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-03-14 14:53:04,229 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-03-14 14:53:04,237 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1678805584119 2023-03-14 14:53:04,252 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-03-14 14:53:04,253 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-03-14 14:53:04,253 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,41317,1678805580877, state=OPEN 2023-03-14 14:53:04,255 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-03-14 14:53:04,256 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-03-14 14:53:04,260 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-03-14 14:53:04,260 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,41317,1678805580877 in 310 msec 2023-03-14 14:53:04,265 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-03-14 14:53:04,266 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 493 msec 2023-03-14 14:53:04,272 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.1370 sec 2023-03-14 14:53:04,272 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1678805584272, completionTime=-1 2023-03-14 14:53:04,272 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-03-14 14:53:04,273 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-03-14 14:53:04,330 DEBUG [hconnection-0x1e0200f5-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-14 14:53:04,333 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:40800, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-14 14:53:04,350 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=1 2023-03-14 14:53:04,350 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1678805644350 2023-03-14 14:53:04,350 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1678805704350 2023-03-14 14:53:04,350 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 77 msec 2023-03-14 14:53:04,387 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,38031,1678805579674-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-03-14 14:53:04,387 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,38031,1678805579674-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-03-14 14:53:04,387 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,38031,1678805579674-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-03-14 14:53:04,389 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase20:38031, period=300000, unit=MILLISECONDS is enabled. 2023-03-14 14:53:04,389 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-03-14 14:53:04,397 DEBUG [master/jenkins-hbase20:0.Chore.1] janitor.CatalogJanitor(175): 2023-03-14 14:53:04,402 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-03-14 14:53:04,404 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-03-14 14:53:04,412 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-03-14 14:53:04,415 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-03-14 14:53:04,417 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-14 14:53:04,440 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/hbase/namespace/10546b400d27bbc83495bff794d39660 2023-03-14 14:53:04,443 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/hbase/namespace/10546b400d27bbc83495bff794d39660 empty. 2023-03-14 14:53:04,443 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/hbase/namespace/10546b400d27bbc83495bff794d39660 2023-03-14 14:53:04,443 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-03-14 14:53:04,865 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-03-14 14:53:04,867 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 10546b400d27bbc83495bff794d39660, NAME => 'hbase:namespace,,1678805584403.10546b400d27bbc83495bff794d39660.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp 2023-03-14 14:53:05,281 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1678805584403.10546b400d27bbc83495bff794d39660.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 14:53:05,281 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 10546b400d27bbc83495bff794d39660, disabling compactions & flushes 2023-03-14 14:53:05,281 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1678805584403.10546b400d27bbc83495bff794d39660. 2023-03-14 14:53:05,281 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1678805584403.10546b400d27bbc83495bff794d39660. 2023-03-14 14:53:05,281 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1678805584403.10546b400d27bbc83495bff794d39660. after waiting 0 ms 2023-03-14 14:53:05,281 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1678805584403.10546b400d27bbc83495bff794d39660. 2023-03-14 14:53:05,281 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1678805584403.10546b400d27bbc83495bff794d39660. 2023-03-14 14:53:05,281 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 10546b400d27bbc83495bff794d39660: 2023-03-14 14:53:05,286 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-03-14 14:53:05,304 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1678805584403.10546b400d27bbc83495bff794d39660.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1678805585290"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678805585290"}]},"ts":"1678805585290"} 2023-03-14 14:53:05,330 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-14 14:53:05,332 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-14 14:53:05,336 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678805585332"}]},"ts":"1678805585332"} 2023-03-14 14:53:05,340 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-03-14 14:53:05,349 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=10546b400d27bbc83495bff794d39660, ASSIGN}] 2023-03-14 14:53:05,352 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=10546b400d27bbc83495bff794d39660, ASSIGN 2023-03-14 14:53:05,354 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=10546b400d27bbc83495bff794d39660, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,41317,1678805580877; forceNewPlan=false, retain=false 2023-03-14 14:53:05,505 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=10546b400d27bbc83495bff794d39660, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:05,505 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1678805584403.10546b400d27bbc83495bff794d39660.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1678805585504"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1678805585504"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678805585504"}]},"ts":"1678805585504"} 2023-03-14 14:53:05,511 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 10546b400d27bbc83495bff794d39660, server=jenkins-hbase20.apache.org,41317,1678805580877}] 2023-03-14 14:53:05,671 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1678805584403.10546b400d27bbc83495bff794d39660. 2023-03-14 14:53:05,672 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 10546b400d27bbc83495bff794d39660, NAME => 'hbase:namespace,,1678805584403.10546b400d27bbc83495bff794d39660.', STARTKEY => '', ENDKEY => ''} 2023-03-14 14:53:05,672 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 10546b400d27bbc83495bff794d39660 2023-03-14 14:53:05,673 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1678805584403.10546b400d27bbc83495bff794d39660.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 14:53:05,673 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 10546b400d27bbc83495bff794d39660 2023-03-14 14:53:05,673 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 10546b400d27bbc83495bff794d39660 2023-03-14 14:53:05,675 INFO [StoreOpener-10546b400d27bbc83495bff794d39660-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 10546b400d27bbc83495bff794d39660 2023-03-14 14:53:05,678 DEBUG [StoreOpener-10546b400d27bbc83495bff794d39660-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/hbase/namespace/10546b400d27bbc83495bff794d39660/info 2023-03-14 14:53:05,678 DEBUG [StoreOpener-10546b400d27bbc83495bff794d39660-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/hbase/namespace/10546b400d27bbc83495bff794d39660/info 2023-03-14 14:53:05,678 INFO [StoreOpener-10546b400d27bbc83495bff794d39660-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 10546b400d27bbc83495bff794d39660 columnFamilyName info 2023-03-14 14:53:05,679 INFO [StoreOpener-10546b400d27bbc83495bff794d39660-1] regionserver.HStore(310): Store=10546b400d27bbc83495bff794d39660/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 14:53:05,682 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/hbase/namespace/10546b400d27bbc83495bff794d39660 2023-03-14 14:53:05,683 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/hbase/namespace/10546b400d27bbc83495bff794d39660 2023-03-14 14:53:05,688 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 10546b400d27bbc83495bff794d39660 2023-03-14 14:53:05,692 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/hbase/namespace/10546b400d27bbc83495bff794d39660/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-14 14:53:05,692 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 10546b400d27bbc83495bff794d39660; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59141576, jitterRate=-0.1187218427658081}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-14 14:53:05,693 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 10546b400d27bbc83495bff794d39660: 2023-03-14 14:53:05,695 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1678805584403.10546b400d27bbc83495bff794d39660., pid=6, masterSystemTime=1678805585664 2023-03-14 14:53:05,699 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1678805584403.10546b400d27bbc83495bff794d39660. 2023-03-14 14:53:05,699 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1678805584403.10546b400d27bbc83495bff794d39660. 2023-03-14 14:53:05,701 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=10546b400d27bbc83495bff794d39660, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:05,701 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1678805584403.10546b400d27bbc83495bff794d39660.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1678805585700"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1678805585700"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678805585700"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678805585700"}]},"ts":"1678805585700"} 2023-03-14 14:53:05,710 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-03-14 14:53:05,710 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 10546b400d27bbc83495bff794d39660, server=jenkins-hbase20.apache.org,41317,1678805580877 in 195 msec 2023-03-14 14:53:05,713 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-03-14 14:53:05,714 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=10546b400d27bbc83495bff794d39660, ASSIGN in 361 msec 2023-03-14 14:53:05,715 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-14 14:53:05,715 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678805585715"}]},"ts":"1678805585715"} 2023-03-14 14:53:05,719 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-03-14 14:53:05,722 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-03-14 14:53:05,726 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 1.3180 sec 2023-03-14 14:53:05,815 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-03-14 14:53:05,816 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-03-14 14:53:05,817 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-14 14:53:05,858 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-03-14 14:53:05,882 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-03-14 14:53:05,888 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 41 msec 2023-03-14 14:53:05,895 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-03-14 14:53:05,907 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-03-14 14:53:05,913 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 17 msec 2023-03-14 14:53:05,920 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-03-14 14:53:05,921 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-03-14 14:53:05,922 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 4.954sec 2023-03-14 14:53:05,924 INFO [master/jenkins-hbase20:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-03-14 14:53:05,925 INFO [master/jenkins-hbase20:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-03-14 14:53:05,926 INFO [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-03-14 14:53:05,926 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,38031,1678805579674-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-03-14 14:53:05,928 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,38031,1678805579674-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-03-14 14:53:05,939 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-03-14 14:53:05,952 DEBUG [Listener at localhost.localdomain/44261] zookeeper.ReadOnlyZKClient(139): Connect 0x11ea4006 to 127.0.0.1:50211 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-14 14:53:05,957 DEBUG [Listener at localhost.localdomain/44261] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4e84ba3d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-14 14:53:05,974 DEBUG [hconnection-0x131f5260-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-14 14:53:05,988 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:40804, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-14 14:53:06,000 INFO [Listener at localhost.localdomain/44261] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase20.apache.org,38031,1678805579674 2023-03-14 14:53:06,001 DEBUG [Listener at localhost.localdomain/44261] zookeeper.ReadOnlyZKClient(139): Connect 0x1f820396 to 127.0.0.1:50211 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-14 14:53:06,005 DEBUG [Listener at localhost.localdomain/44261] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@10204f91, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-14 14:53:06,006 INFO [Listener at localhost.localdomain/44261] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-14 14:53:06,030 INFO [Listener at localhost.localdomain/44261] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=210, OpenFileDescriptor=475, MaxFileDescriptor=60000, SystemLoadAverage=389, ProcessCount=167, AvailableMemoryMB=13154 2023-03-14 14:53:06,042 DEBUG [Listener at localhost.localdomain/44261] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-14 14:53:06,046 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:42570, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-14 14:53:06,062 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-03-14 14:53:06,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:06,067 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_PRE_OPERATION 2023-03-14 14:53:06,072 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-14 14:53:06,072 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthly" procId is: 9 2023-03-14 14:53:06,078 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e 2023-03-14 14:53:06,079 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e empty. 2023-03-14 14:53:06,082 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e 2023-03-14 14:53:06,082 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthly regions 2023-03-14 14:53:06,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-03-14 14:53:06,104 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-03-14 14:53:06,107 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0b22b7f42a887fbc05e1153fe076072e, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1678805586057.0b22b7f42a887fbc05e1153fe076072e.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp 2023-03-14 14:53:06,124 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1678805586057.0b22b7f42a887fbc05e1153fe076072e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 14:53:06,124 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1604): Closing 0b22b7f42a887fbc05e1153fe076072e, disabling compactions & flushes 2023-03-14 14:53:06,124 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1678805586057.0b22b7f42a887fbc05e1153fe076072e. 2023-03-14 14:53:06,124 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1678805586057.0b22b7f42a887fbc05e1153fe076072e. 2023-03-14 14:53:06,124 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1678805586057.0b22b7f42a887fbc05e1153fe076072e. after waiting 0 ms 2023-03-14 14:53:06,124 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1678805586057.0b22b7f42a887fbc05e1153fe076072e. 2023-03-14 14:53:06,124 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1678805586057.0b22b7f42a887fbc05e1153fe076072e. 2023-03-14 14:53:06,124 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1558): Region close journal for 0b22b7f42a887fbc05e1153fe076072e: 2023-03-14 14:53:06,129 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ADD_TO_META 2023-03-14 14:53:06,131 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1678805586057.0b22b7f42a887fbc05e1153fe076072e.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1678805586130"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678805586130"}]},"ts":"1678805586130"} 2023-03-14 14:53:06,133 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-14 14:53:06,135 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-14 14:53:06,135 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678805586135"}]},"ts":"1678805586135"} 2023-03-14 14:53:06,138 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLING in hbase:meta 2023-03-14 14:53:06,141 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=0b22b7f42a887fbc05e1153fe076072e, ASSIGN}] 2023-03-14 14:53:06,143 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=0b22b7f42a887fbc05e1153fe076072e, ASSIGN 2023-03-14 14:53:06,146 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=0b22b7f42a887fbc05e1153fe076072e, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,41317,1678805580877; forceNewPlan=false, retain=false 2023-03-14 14:53:06,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-03-14 14:53:06,298 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=0b22b7f42a887fbc05e1153fe076072e, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:06,298 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1678805586057.0b22b7f42a887fbc05e1153fe076072e.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1678805586298"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1678805586298"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678805586298"}]},"ts":"1678805586298"} 2023-03-14 14:53:06,302 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 0b22b7f42a887fbc05e1153fe076072e, server=jenkins-hbase20.apache.org,41317,1678805580877}] 2023-03-14 14:53:06,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-03-14 14:53:06,461 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1678805586057.0b22b7f42a887fbc05e1153fe076072e. 2023-03-14 14:53:06,461 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0b22b7f42a887fbc05e1153fe076072e, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1678805586057.0b22b7f42a887fbc05e1153fe076072e.', STARTKEY => '', ENDKEY => ''} 2023-03-14 14:53:06,462 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 0b22b7f42a887fbc05e1153fe076072e 2023-03-14 14:53:06,462 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1678805586057.0b22b7f42a887fbc05e1153fe076072e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 14:53:06,462 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 0b22b7f42a887fbc05e1153fe076072e 2023-03-14 14:53:06,462 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 0b22b7f42a887fbc05e1153fe076072e 2023-03-14 14:53:06,465 INFO [StoreOpener-0b22b7f42a887fbc05e1153fe076072e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 0b22b7f42a887fbc05e1153fe076072e 2023-03-14 14:53:06,467 DEBUG [StoreOpener-0b22b7f42a887fbc05e1153fe076072e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1 2023-03-14 14:53:06,467 DEBUG [StoreOpener-0b22b7f42a887fbc05e1153fe076072e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1 2023-03-14 14:53:06,470 INFO [StoreOpener-0b22b7f42a887fbc05e1153fe076072e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0b22b7f42a887fbc05e1153fe076072e columnFamilyName family1 2023-03-14 14:53:06,473 INFO [StoreOpener-0b22b7f42a887fbc05e1153fe076072e-1] regionserver.HStore(310): Store=0b22b7f42a887fbc05e1153fe076072e/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 14:53:06,476 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e 2023-03-14 14:53:06,477 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e 2023-03-14 14:53:06,482 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 0b22b7f42a887fbc05e1153fe076072e 2023-03-14 14:53:06,486 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-14 14:53:06,488 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 0b22b7f42a887fbc05e1153fe076072e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68273315, jitterRate=0.017351672053337097}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-14 14:53:06,488 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 0b22b7f42a887fbc05e1153fe076072e: 2023-03-14 14:53:06,489 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1678805586057.0b22b7f42a887fbc05e1153fe076072e., pid=11, masterSystemTime=1678805586455 2023-03-14 14:53:06,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1678805586057.0b22b7f42a887fbc05e1153fe076072e. 2023-03-14 14:53:06,493 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1678805586057.0b22b7f42a887fbc05e1153fe076072e. 2023-03-14 14:53:06,494 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=0b22b7f42a887fbc05e1153fe076072e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:06,494 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1678805586057.0b22b7f42a887fbc05e1153fe076072e.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1678805586494"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1678805586494"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678805586494"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678805586494"}]},"ts":"1678805586494"} 2023-03-14 14:53:06,502 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-03-14 14:53:06,502 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 0b22b7f42a887fbc05e1153fe076072e, server=jenkins-hbase20.apache.org,41317,1678805580877 in 197 msec 2023-03-14 14:53:06,506 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-03-14 14:53:06,506 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=0b22b7f42a887fbc05e1153fe076072e, ASSIGN in 361 msec 2023-03-14 14:53:06,508 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-14 14:53:06,508 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678805586508"}]},"ts":"1678805586508"} 2023-03-14 14:53:06,510 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLED in hbase:meta 2023-03-14 14:53:06,513 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_POST_OPERATION 2023-03-14 14:53:06,516 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 451 msec 2023-03-14 14:53:06,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-03-14 14:53:06,692 INFO [Listener at localhost.localdomain/44261] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthly, procId: 9 completed 2023-03-14 14:53:06,709 DEBUG [hconnection-0x77a349b7-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-14 14:53:06,713 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:40808, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-14 14:53:07,000 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:53:07,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:07,026 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-14 14:53:07,026 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:53:07,026 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-14 14:53:07,027 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-14 14:53:07,027 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:07,027 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:07,028 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:53:07,028 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:07,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:53:07,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:53:07,029 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:07,029 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:53:07,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:07,029 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:07,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:53:07,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:07,030 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:07,031 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:07,032 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-14 14:53:07,032 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:53:07,032 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-14 14:53:07,041 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 14:53:07,041 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678805586057.0b22b7f42a887fbc05e1153fe076072e. 2023-03-14 14:53:07,041 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:53:07,042 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1678805586057.0b22b7f42a887fbc05e1153fe076072e. started... 2023-03-14 14:53:07,043 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0b22b7f42a887fbc05e1153fe076072e 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-14 14:53:07,277 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113056d3177767684cc896854d9ad4d2f344 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015113056d3177767684cc896854d9ad4d2f344 2023-03-14 14:53:07,305 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/.tmp/family1/290b0fc69668439e956dc6e745d2b173 2023-03-14 14:53:07,324 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/.tmp/family1/290b0fc69668439e956dc6e745d2b173 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/290b0fc69668439e956dc6e745d2b173 2023-03-14 14:53:07,332 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/290b0fc69668439e956dc6e745d2b173, entries=1000, sequenceid=5, filesize=175.8 K 2023-03-14 14:53:07,334 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 0b22b7f42a887fbc05e1153fe076072e in 291ms, sequenceid=5, compaction requested=false 2023-03-14 14:53:07,336 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-14 14:53:07,340 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0b22b7f42a887fbc05e1153fe076072e: 2023-03-14 14:53:07,340 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678805586057.0b22b7f42a887fbc05e1153fe076072e. 2023-03-14 14:53:07,340 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 14:53:07,340 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 14:53:07,340 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:07,340 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-14 14:53:07,340 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-14 14:53:07,342 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:07,342 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:07,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:07,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:07,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:07,343 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:07,343 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:53:07,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:07,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:07,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:07,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:07,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:07,345 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-14 14:53:07,345 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-14 14:53:07,345 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1130a1f6[Count = 0] remaining members to acquire global barrier 2023-03-14 14:53:07,345 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:07,346 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:07,346 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:07,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:07,346 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-14 14:53:07,346 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-14 14:53:07,346 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:07,346 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:53:07,346 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:53:07,348 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:07,348 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-14 14:53:07,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:07,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:07,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:07,348 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:53:07,348 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-14 14:53:07,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:07,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:07,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:07,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:07,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:07,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:07,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:07,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:53:07,352 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-14 14:53:07,352 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-14 14:53:07,352 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:53:07,352 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:53:07,352 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:07,352 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:53:07,360 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:07,360 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:07,360 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:53:07,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:07,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:07,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:07,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:07,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:07,361 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:07,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:07,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:53:07,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:53:07,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:07,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:07,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:07,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:07,363 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:07,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:07,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:07,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:07,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:07,369 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:07,369 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:07,369 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:07,369 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:07,370 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:07,370 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:07,370 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:07,370 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:53:07,370 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-14 14:53:07,370 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:53:07,370 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:53:07,370 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-14 14:53:07,420 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-14 14:53:07,371 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:53:07,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:53:07,371 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:53:07,420 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:53:07,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:53:07,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:53:07,520 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:53:07,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:53:07,535 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:53:07,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-14 14:53:07,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:07,542 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-14 14:53:07,542 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:53:07,543 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-14 14:53:07,543 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-14 14:53:07,543 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:07,543 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:07,544 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:53:07,544 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:53:07,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:53:07,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:07,545 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:07,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:53:07,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:07,545 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:07,549 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:07,549 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:07,549 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:53:07,550 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:07,550 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-14 14:53:07,550 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:53:07,550 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-14 14:53:07,552 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 14:53:07,552 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:53:07,552 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678805586057.0b22b7f42a887fbc05e1153fe076072e. 2023-03-14 14:53:07,553 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1678805586057.0b22b7f42a887fbc05e1153fe076072e. started... 2023-03-14 14:53:07,553 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0b22b7f42a887fbc05e1153fe076072e 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-14 14:53:08,037 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112808937504b81a42adadeae654d9f4f48e to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112808937504b81a42adadeae654d9f4f48e 2023-03-14 14:53:08,078 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/.tmp/family1/abec8f5598174992a6efaa949aa3d83b 2023-03-14 14:53:08,094 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/.tmp/family1/abec8f5598174992a6efaa949aa3d83b as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/abec8f5598174992a6efaa949aa3d83b 2023-03-14 14:53:08,103 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/abec8f5598174992a6efaa949aa3d83b, entries=1, sequenceid=9, filesize=5.0 K 2023-03-14 14:53:08,104 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 0b22b7f42a887fbc05e1153fe076072e in 551ms, sequenceid=9, compaction requested=false 2023-03-14 14:53:08,105 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0b22b7f42a887fbc05e1153fe076072e: 2023-03-14 14:53:08,105 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678805586057.0b22b7f42a887fbc05e1153fe076072e. 2023-03-14 14:53:08,105 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 14:53:08,105 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 14:53:08,105 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:08,106 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-14 14:53:08,106 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-14 14:53:08,107 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:08,107 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:08,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:08,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:08,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:08,107 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:08,108 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:53:08,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:08,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:08,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:08,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:08,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:08,109 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-14 14:53:08,109 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4296375a[Count = 0] remaining members to acquire global barrier 2023-03-14 14:53:08,110 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-14 14:53:08,110 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:08,110 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:08,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:08,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:08,110 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-14 14:53:08,110 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-14 14:53:08,110 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:53:08,111 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:08,111 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:53:08,113 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:08,113 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-14 14:53:08,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:08,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:08,113 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:53:08,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:08,113 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-14 14:53:08,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:08,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:08,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:08,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:08,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:08,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:08,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:08,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:53:08,117 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-14 14:53:08,117 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-14 14:53:08,117 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:53:08,117 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:53:08,117 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:08,117 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:53:08,120 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:08,120 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:53:08,120 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:08,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:08,120 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:08,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:08,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:08,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:08,120 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:53:08,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:53:08,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:08,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:08,122 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:08,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:08,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:08,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:08,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:08,128 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:08,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:08,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:08,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:08,133 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:53:08,133 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:53:08,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:53:08,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:53:08,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:53:08,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:53:08,134 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:08,134 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:08,134 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:08,134 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:08,134 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:08,134 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:08,134 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:08,134 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:53:08,134 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-14 14:53:08,134 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:53:08,135 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-14 14:53:08,135 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:53:08,236 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:53:08,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:53:08,244 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:53:08,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-14 14:53:08,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:08,259 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-14 14:53:08,259 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:53:08,259 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-14 14:53:08,259 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-14 14:53:08,260 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:08,260 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:08,261 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:08,261 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:53:08,261 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:53:08,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:53:08,261 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:08,261 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:53:08,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:08,262 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:08,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:53:08,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:08,262 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:08,266 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-14 14:53:08,266 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:08,266 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-14 14:53:08,266 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:53:08,266 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-14 14:53:08,270 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 14:53:08,270 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:53:08,270 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678805586057.0b22b7f42a887fbc05e1153fe076072e. 2023-03-14 14:53:08,270 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1678805586057.0b22b7f42a887fbc05e1153fe076072e. started... 2023-03-14 14:53:08,270 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0b22b7f42a887fbc05e1153fe076072e 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 14:53:08,723 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512010dd8bc92274a419686d5a5764be36a7f to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512010dd8bc92274a419686d5a5764be36a7f 2023-03-14 14:53:08,735 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/.tmp/family1/43f9abba38754c15b93707392ec36a81 2023-03-14 14:53:08,745 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/.tmp/family1/43f9abba38754c15b93707392ec36a81 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/43f9abba38754c15b93707392ec36a81 2023-03-14 14:53:08,754 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/43f9abba38754c15b93707392ec36a81, entries=1, sequenceid=13, filesize=5.0 K 2023-03-14 14:53:08,755 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0b22b7f42a887fbc05e1153fe076072e in 485ms, sequenceid=13, compaction requested=true 2023-03-14 14:53:08,756 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0b22b7f42a887fbc05e1153fe076072e: 2023-03-14 14:53:08,756 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678805586057.0b22b7f42a887fbc05e1153fe076072e. 2023-03-14 14:53:08,756 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 14:53:08,757 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 14:53:08,757 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:08,757 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-14 14:53:08,757 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-14 14:53:08,759 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:08,759 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:08,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:08,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:08,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:08,759 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:08,759 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:53:08,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:08,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:08,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:08,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:08,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:08,761 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-14 14:53:08,761 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@a7b1d67[Count = 0] remaining members to acquire global barrier 2023-03-14 14:53:08,761 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-14 14:53:08,761 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:08,762 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:08,762 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:08,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:08,762 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-14 14:53:08,762 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-14 14:53:08,762 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:08,762 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:53:08,762 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:53:08,764 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:08,764 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-14 14:53:08,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:08,764 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:53:08,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:08,764 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-14 14:53:08,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:08,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:08,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:08,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:08,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:08,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:08,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:08,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:08,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:53:08,767 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-14 14:53:08,767 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-14 14:53:08,767 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:53:08,767 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:53:08,767 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:08,767 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:53:08,768 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:08,769 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:53:08,769 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:08,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:08,769 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:08,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:08,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:08,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:08,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:53:08,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:53:08,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:08,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:08,775 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:08,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:08,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:08,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:08,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:08,776 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:08,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:08,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:08,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:08,789 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:08,789 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:53:08,790 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:08,790 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:53:08,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:53:08,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:53:08,790 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-14 14:53:08,790 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:53:08,790 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:08,790 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:08,790 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:53:08,790 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:08,790 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:08,790 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:08,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:53:08,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:53:08,791 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-14 14:53:08,791 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:53:08,891 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:53:08,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:53:08,902 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:53:08,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-14 14:53:08,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:08,905 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-14 14:53:08,905 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:53:08,906 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-14 14:53:08,906 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-14 14:53:08,906 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:08,906 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:08,907 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:53:08,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:53:08,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:53:08,908 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:08,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:08,909 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:08,909 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:53:08,909 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:08,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:53:08,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:08,910 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:08,911 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-14 14:53:08,911 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:08,911 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-14 14:53:08,911 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:53:08,911 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-14 14:53:08,912 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 14:53:08,912 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:53:08,912 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678805586057.0b22b7f42a887fbc05e1153fe076072e. 2023-03-14 14:53:08,912 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1678805586057.0b22b7f42a887fbc05e1153fe076072e. started... 2023-03-14 14:53:08,912 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0b22b7f42a887fbc05e1153fe076072e 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 14:53:08,945 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205fb0467ec940f447ebbce3e4d8c189eab to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205fb0467ec940f447ebbce3e4d8c189eab 2023-03-14 14:53:09,361 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/.tmp/family1/afce427f062b42769f54843d77d1b74c 2023-03-14 14:53:09,374 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/.tmp/family1/afce427f062b42769f54843d77d1b74c as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/afce427f062b42769f54843d77d1b74c 2023-03-14 14:53:09,383 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/afce427f062b42769f54843d77d1b74c, entries=1, sequenceid=17, filesize=5.0 K 2023-03-14 14:53:09,385 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0b22b7f42a887fbc05e1153fe076072e in 473ms, sequenceid=17, compaction requested=true 2023-03-14 14:53:09,385 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0b22b7f42a887fbc05e1153fe076072e: 2023-03-14 14:53:09,385 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678805586057.0b22b7f42a887fbc05e1153fe076072e. 2023-03-14 14:53:09,385 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 14:53:09,385 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 14:53:09,385 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:09,385 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-14 14:53:09,385 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-14 14:53:09,387 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:09,387 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:09,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:09,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:09,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:09,387 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:09,387 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:53:09,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:09,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:09,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:09,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:09,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:09,390 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-14 14:53:09,390 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2401c1df[Count = 0] remaining members to acquire global barrier 2023-03-14 14:53:09,390 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-14 14:53:09,390 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:09,500 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:09,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:09,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:09,501 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-14 14:53:09,501 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-14 14:53:09,501 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:53:09,501 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:09,501 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:53:09,502 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-14 14:53:09,503 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:53:09,503 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-14 14:53:09,502 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:09,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:09,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:09,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:09,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:09,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:09,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:09,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:09,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:09,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:09,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:09,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:53:09,507 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-14 14:53:09,507 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-14 14:53:09,507 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:53:09,507 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:53:09,507 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:09,507 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:53:09,514 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:09,514 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:09,514 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:09,514 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:53:09,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:09,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:09,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:09,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:09,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:53:09,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:53:09,515 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:09,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:09,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:09,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:09,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:09,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:09,517 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:09,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:09,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:09,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:09,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:09,523 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:09,523 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:53:09,523 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:09,523 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:53:09,523 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:53:09,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:53:09,523 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:09,523 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-14 14:53:09,523 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-14 14:53:09,523 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:53:09,523 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:53:09,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:53:09,523 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:53:09,523 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:09,524 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:09,524 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:09,524 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:09,524 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-14 14:53:09,524 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:53:09,624 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:53:09,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:53:09,635 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:53:09,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-14 14:53:09,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:09,638 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-14 14:53:09,638 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:53:09,639 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-14 14:53:09,639 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-14 14:53:09,640 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:09,640 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:09,641 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:53:09,641 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:09,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:53:09,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:53:09,641 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:09,641 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:53:09,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:09,642 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:09,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:53:09,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:09,642 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:09,642 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-14 14:53:09,642 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:09,642 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-14 14:53:09,642 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:53:09,643 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-14 14:53:09,643 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 14:53:09,643 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:53:09,643 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678805586057.0b22b7f42a887fbc05e1153fe076072e. 2023-03-14 14:53:09,643 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1678805586057.0b22b7f42a887fbc05e1153fe076072e. started... 2023-03-14 14:53:09,643 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0b22b7f42a887fbc05e1153fe076072e 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 14:53:09,727 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-14 14:53:09,790 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-03-14 14:53:09,792 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-03-14 14:53:09,838 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-03-14 14:53:09,839 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-03-14 14:53:10,068 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228ab0b80aabd83489fb0cb75c67f37d67d to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228ab0b80aabd83489fb0cb75c67f37d67d 2023-03-14 14:53:10,081 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/.tmp/family1/fbb9c9195dc743c097f58346447d2a90 2023-03-14 14:53:10,090 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/.tmp/family1/fbb9c9195dc743c097f58346447d2a90 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/fbb9c9195dc743c097f58346447d2a90 2023-03-14 14:53:10,099 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/fbb9c9195dc743c097f58346447d2a90, entries=1, sequenceid=21, filesize=5.0 K 2023-03-14 14:53:10,100 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0b22b7f42a887fbc05e1153fe076072e in 457ms, sequenceid=21, compaction requested=true 2023-03-14 14:53:10,100 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0b22b7f42a887fbc05e1153fe076072e: 2023-03-14 14:53:10,100 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678805586057.0b22b7f42a887fbc05e1153fe076072e. 2023-03-14 14:53:10,100 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 14:53:10,101 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 14:53:10,101 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:10,101 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-14 14:53:10,101 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-14 14:53:10,104 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:10,104 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:10,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:10,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:10,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:10,104 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:10,104 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:53:10,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:10,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:10,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:10,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:10,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:10,106 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-14 14:53:10,106 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@302aebb8[Count = 0] remaining members to acquire global barrier 2023-03-14 14:53:10,106 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-14 14:53:10,106 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:10,107 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:10,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:10,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:10,107 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-14 14:53:10,107 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:10,107 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:53:10,107 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-14 14:53:10,107 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:53:10,108 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:10,108 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-14 14:53:10,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:10,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:10,108 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:53:10,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:10,108 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-14 14:53:10,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:10,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:10,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:10,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:10,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:10,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:10,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:10,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:53:10,111 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-14 14:53:10,111 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-14 14:53:10,111 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:53:10,111 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:53:10,111 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:10,111 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:53:10,112 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:10,112 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:10,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:10,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:10,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:10,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:10,112 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:53:10,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:10,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:10,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:53:10,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:53:10,113 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:10,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:10,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:10,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:10,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:10,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:10,114 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:10,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:10,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:10,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:10,116 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:10,116 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:53:10,116 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:10,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:53:10,116 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:53:10,116 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:10,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:53:10,117 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-14 14:53:10,117 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:53:10,117 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:53:10,117 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:10,117 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:53:10,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:53:10,117 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-14 14:53:10,117 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:10,117 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:53:10,118 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:10,118 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:10,218 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:53:10,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:53:10,228 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:53:10,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-14 14:53:10,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:10,230 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-14 14:53:10,230 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:53:10,231 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-14 14:53:10,231 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-14 14:53:10,231 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:10,231 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:10,232 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:10,232 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:53:10,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:53:10,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:53:10,233 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:10,233 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:53:10,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:10,233 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:10,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:53:10,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:10,234 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:10,234 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-14 14:53:10,234 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:10,234 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-14 14:53:10,234 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:53:10,235 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-14 14:53:10,235 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 14:53:10,235 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:53:10,235 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678805586057.0b22b7f42a887fbc05e1153fe076072e. 2023-03-14 14:53:10,235 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1678805586057.0b22b7f42a887fbc05e1153fe076072e. started... 2023-03-14 14:53:10,235 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0b22b7f42a887fbc05e1153fe076072e 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 14:53:10,658 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231065d13f8534640b5821ea8d31a460bdc to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231065d13f8534640b5821ea8d31a460bdc 2023-03-14 14:53:11,073 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/.tmp/family1/05bd611ab6bb4f7a8e346336976b5c44 2023-03-14 14:53:11,082 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/.tmp/family1/05bd611ab6bb4f7a8e346336976b5c44 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/05bd611ab6bb4f7a8e346336976b5c44 2023-03-14 14:53:11,091 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/05bd611ab6bb4f7a8e346336976b5c44, entries=1, sequenceid=25, filesize=5.0 K 2023-03-14 14:53:11,092 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0b22b7f42a887fbc05e1153fe076072e in 857ms, sequenceid=25, compaction requested=true 2023-03-14 14:53:11,092 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0b22b7f42a887fbc05e1153fe076072e: 2023-03-14 14:53:11,092 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678805586057.0b22b7f42a887fbc05e1153fe076072e. 2023-03-14 14:53:11,092 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 14:53:11,093 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 14:53:11,093 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:11,093 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-14 14:53:11,093 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-14 14:53:11,094 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:11,094 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:11,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:11,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:11,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:11,094 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:11,095 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:53:11,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:11,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:11,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:11,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:11,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:11,096 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-14 14:53:11,096 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@43752600[Count = 0] remaining members to acquire global barrier 2023-03-14 14:53:11,096 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-14 14:53:11,096 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:11,097 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:11,097 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:11,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:11,097 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-14 14:53:11,097 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-14 14:53:11,097 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:53:11,097 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:11,098 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:53:11,098 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-14 14:53:11,099 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:11,099 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:53:11,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:11,099 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-14 14:53:11,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:11,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:11,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:11,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:11,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:11,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:11,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:11,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:11,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:11,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:53:11,102 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-14 14:53:11,102 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-14 14:53:11,102 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:53:11,102 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:53:11,102 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:11,102 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:53:11,103 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:11,104 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:11,104 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:11,104 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:53:11,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:11,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:11,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:11,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:11,104 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:53:11,104 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:11,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:11,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:53:11,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:11,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:11,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:11,106 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:11,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:11,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:11,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:11,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:11,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:11,108 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:11,108 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:53:11,108 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:53:11,108 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:11,108 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:53:11,108 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-14 14:53:11,108 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:53:11,108 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:53:11,108 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:11,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:53:11,110 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-14 14:53:11,110 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:53:11,109 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:11,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:53:11,110 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:11,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:53:11,110 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:11,110 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:11,110 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-14 14:53:11,210 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:53:11,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:53:11,219 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:53:11,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-14 14:53:11,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:11,222 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-14 14:53:11,222 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:53:11,222 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-14 14:53:11,222 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-14 14:53:11,223 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:11,223 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:11,224 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:53:11,224 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:11,224 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:53:11,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:53:11,224 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:11,224 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:53:11,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:11,224 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:11,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:53:11,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:11,225 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:11,225 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-14 14:53:11,225 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:11,225 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-14 14:53:11,226 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:53:11,226 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-14 14:53:11,226 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 14:53:11,226 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:53:11,226 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678805586057.0b22b7f42a887fbc05e1153fe076072e. 2023-03-14 14:53:11,226 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1678805586057.0b22b7f42a887fbc05e1153fe076072e. started... 2023-03-14 14:53:11,226 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0b22b7f42a887fbc05e1153fe076072e 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 14:53:11,648 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010169f11ba93bd0413c8698a62349b2b481 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010169f11ba93bd0413c8698a62349b2b481 2023-03-14 14:53:12,057 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/.tmp/family1/d74875e675ed4348a3d422ce616aaa62 2023-03-14 14:53:12,065 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/.tmp/family1/d74875e675ed4348a3d422ce616aaa62 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/d74875e675ed4348a3d422ce616aaa62 2023-03-14 14:53:12,075 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/d74875e675ed4348a3d422ce616aaa62, entries=1, sequenceid=29, filesize=5.0 K 2023-03-14 14:53:12,076 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0b22b7f42a887fbc05e1153fe076072e in 850ms, sequenceid=29, compaction requested=true 2023-03-14 14:53:12,076 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0b22b7f42a887fbc05e1153fe076072e: 2023-03-14 14:53:12,076 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678805586057.0b22b7f42a887fbc05e1153fe076072e. 2023-03-14 14:53:12,076 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 14:53:12,077 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 14:53:12,077 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:12,077 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-14 14:53:12,077 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-14 14:53:12,079 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:12,079 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:12,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:12,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:12,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:12,079 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:12,079 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:53:12,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:12,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:12,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:12,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:12,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:12,081 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-14 14:53:12,081 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@11379b2c[Count = 0] remaining members to acquire global barrier 2023-03-14 14:53:12,081 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-14 14:53:12,081 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:12,082 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:12,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:12,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:12,082 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-14 14:53:12,082 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-14 14:53:12,082 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:12,082 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:53:12,082 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:53:12,083 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-14 14:53:12,083 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:12,083 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:53:12,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:12,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:12,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:12,083 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-14 14:53:12,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:12,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:12,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:12,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:12,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:12,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:12,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:12,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:53:12,086 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-14 14:53:12,086 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-14 14:53:12,086 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:53:12,086 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:53:12,086 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:12,086 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:53:12,087 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:12,087 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:12,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:12,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:12,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:12,087 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:53:12,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:12,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:12,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:12,088 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:53:12,088 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:12,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:53:12,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:12,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:12,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:12,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:12,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:12,089 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:12,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:12,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:12,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:12,092 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:53:12,092 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:12,092 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:53:12,092 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:12,092 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:53:12,092 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:12,092 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:53:12,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:53:12,092 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:12,092 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-14 14:53:12,093 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:53:12,093 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:12,093 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:12,093 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:12,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:53:12,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:53:12,093 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-14 14:53:12,093 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:53:12,193 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:53:12,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:53:12,204 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:53:12,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-14 14:53:12,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:12,206 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-14 14:53:12,206 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:53:12,207 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-14 14:53:12,207 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-14 14:53:12,208 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:12,208 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:12,209 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:12,209 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:53:12,209 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:53:12,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:53:12,209 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:12,209 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:53:12,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:12,210 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:12,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:53:12,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:12,210 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:12,210 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-14 14:53:12,210 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:12,210 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-14 14:53:12,210 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:53:12,211 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-14 14:53:12,211 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 14:53:12,211 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:53:12,211 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678805586057.0b22b7f42a887fbc05e1153fe076072e. 2023-03-14 14:53:12,211 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1678805586057.0b22b7f42a887fbc05e1153fe076072e. started... 2023-03-14 14:53:12,211 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0b22b7f42a887fbc05e1153fe076072e 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 14:53:12,634 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103bb07415425364d8a8d0aae650fee2382 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103bb07415425364d8a8d0aae650fee2382 2023-03-14 14:53:13,046 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/.tmp/family1/2aab3d77db42464fb5f9e1c2c46874d7 2023-03-14 14:53:13,055 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/.tmp/family1/2aab3d77db42464fb5f9e1c2c46874d7 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/2aab3d77db42464fb5f9e1c2c46874d7 2023-03-14 14:53:13,063 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/2aab3d77db42464fb5f9e1c2c46874d7, entries=1, sequenceid=33, filesize=5.0 K 2023-03-14 14:53:13,065 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0b22b7f42a887fbc05e1153fe076072e in 854ms, sequenceid=33, compaction requested=true 2023-03-14 14:53:13,065 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0b22b7f42a887fbc05e1153fe076072e: 2023-03-14 14:53:13,065 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678805586057.0b22b7f42a887fbc05e1153fe076072e. 2023-03-14 14:53:13,065 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 14:53:13,066 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 14:53:13,066 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:13,066 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-14 14:53:13,066 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-14 14:53:13,067 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:13,067 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:13,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:13,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:13,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:13,068 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:13,068 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:53:13,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:13,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:13,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:13,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:13,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:13,069 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-14 14:53:13,069 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3b12bfec[Count = 0] remaining members to acquire global barrier 2023-03-14 14:53:13,069 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-14 14:53:13,069 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:13,070 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:13,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:13,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:13,070 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-14 14:53:13,070 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-14 14:53:13,070 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:53:13,070 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:13,070 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:53:13,071 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:13,071 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-14 14:53:13,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:13,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:13,071 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:53:13,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:13,071 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-14 14:53:13,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:13,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:13,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:13,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:13,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:13,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:13,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:13,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:53:13,073 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-14 14:53:13,073 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-14 14:53:13,073 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:53:13,073 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:53:13,074 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:13,074 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:53:13,075 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:13,075 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:13,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:13,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:13,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:13,075 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:13,075 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:53:13,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:13,076 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:13,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:13,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:53:13,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:53:13,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:13,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:13,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:13,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:13,077 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:13,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:13,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:13,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:13,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:13,079 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:13,079 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:13,079 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:53:13,079 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:53:13,079 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:53:13,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:53:13,079 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:53:13,079 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-14 14:53:13,080 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:53:13,079 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:13,080 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-14 14:53:13,080 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:13,080 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:13,080 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:13,080 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-14 14:53:13,080 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:13,080 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:53:13,083 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:53:13,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:53:13,181 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:53:13,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:53:13,191 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:53:13,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-14 14:53:13,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:13,194 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-14 14:53:13,194 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:53:13,194 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-14 14:53:13,194 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-14 14:53:13,195 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:13,195 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:13,196 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:53:13,196 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:13,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:53:13,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:53:13,196 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:13,196 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:53:13,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:13,196 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:13,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:53:13,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:13,197 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:13,197 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-14 14:53:13,198 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:13,198 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-14 14:53:13,198 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:53:13,199 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-14 14:53:13,199 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 14:53:13,199 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:53:13,199 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678805586057.0b22b7f42a887fbc05e1153fe076072e. 2023-03-14 14:53:13,199 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1678805586057.0b22b7f42a887fbc05e1153fe076072e. started... 2023-03-14 14:53:13,199 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0b22b7f42a887fbc05e1153fe076072e 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 14:53:13,619 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907a93cd5a7e6ff43c1918cb96b4d87544f to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20150907a93cd5a7e6ff43c1918cb96b4d87544f 2023-03-14 14:53:14,028 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/.tmp/family1/ca3f7f64bb874e7ba92cb50f46a66c83 2023-03-14 14:53:14,038 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/.tmp/family1/ca3f7f64bb874e7ba92cb50f46a66c83 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/ca3f7f64bb874e7ba92cb50f46a66c83 2023-03-14 14:53:14,045 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/ca3f7f64bb874e7ba92cb50f46a66c83, entries=1, sequenceid=37, filesize=5.0 K 2023-03-14 14:53:14,047 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0b22b7f42a887fbc05e1153fe076072e in 848ms, sequenceid=37, compaction requested=true 2023-03-14 14:53:14,047 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0b22b7f42a887fbc05e1153fe076072e: 2023-03-14 14:53:14,047 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678805586057.0b22b7f42a887fbc05e1153fe076072e. 2023-03-14 14:53:14,047 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 14:53:14,047 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 14:53:14,048 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:14,048 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-14 14:53:14,048 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-14 14:53:14,049 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:14,049 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:14,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:14,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:14,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:14,049 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:14,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:14,049 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:53:14,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:14,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:14,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:14,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:14,051 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-14 14:53:14,051 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5c02f41d[Count = 0] remaining members to acquire global barrier 2023-03-14 14:53:14,051 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-14 14:53:14,051 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:14,052 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:14,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:14,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:14,052 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-14 14:53:14,052 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-14 14:53:14,052 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:14,052 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:53:14,052 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:53:14,053 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:14,053 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-14 14:53:14,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:14,053 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:53:14,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:14,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:14,053 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-14 14:53:14,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:14,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:14,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:14,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:14,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:14,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:14,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:14,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:53:14,056 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-14 14:53:14,056 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-14 14:53:14,056 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:53:14,056 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:53:14,056 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:14,056 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:53:14,057 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:14,057 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:14,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:14,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:14,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:14,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:14,057 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:53:14,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:14,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:14,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:53:14,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:53:14,058 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:14,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:14,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:14,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:14,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:14,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:14,059 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:14,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:14,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:14,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:14,060 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:14,060 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:14,060 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:14,060 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:53:14,060 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:14,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:53:14,060 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:53:14,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:53:14,061 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-14 14:53:14,061 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:53:14,061 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:14,061 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:53:14,061 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:14,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:53:14,061 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:14,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:53:14,062 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-14 14:53:14,062 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:53:14,162 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:53:14,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:53:14,171 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:53:14,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-03-14 14:53:14,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:14,174 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-14 14:53:14,174 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:53:14,175 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-03-14 14:53:14,175 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-03-14 14:53:14,175 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:14,175 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:14,176 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:14,176 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:53:14,177 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:53:14,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:53:14,177 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:14,177 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:53:14,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:14,178 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:14,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:53:14,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:14,178 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:14,179 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-03-14 14:53:14,179 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:14,179 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-03-14 14:53:14,179 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:53:14,180 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-03-14 14:53:14,180 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 14:53:14,180 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:53:14,181 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678805586057.0b22b7f42a887fbc05e1153fe076072e. 2023-03-14 14:53:14,181 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1678805586057.0b22b7f42a887fbc05e1153fe076072e. started... 2023-03-14 14:53:14,181 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0b22b7f42a887fbc05e1153fe076072e 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 14:53:14,626 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112063e92e0796b64e64b1403f609a82ecd4 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112063e92e0796b64e64b1403f609a82ecd4 2023-03-14 14:53:15,036 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/.tmp/family1/9567951d75ae415c91a0cccd38b57de3 2023-03-14 14:53:15,045 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/.tmp/family1/9567951d75ae415c91a0cccd38b57de3 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/9567951d75ae415c91a0cccd38b57de3 2023-03-14 14:53:15,053 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/9567951d75ae415c91a0cccd38b57de3, entries=1, sequenceid=41, filesize=5.0 K 2023-03-14 14:53:15,054 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0b22b7f42a887fbc05e1153fe076072e in 873ms, sequenceid=41, compaction requested=true 2023-03-14 14:53:15,054 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0b22b7f42a887fbc05e1153fe076072e: 2023-03-14 14:53:15,054 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1678805586057.0b22b7f42a887fbc05e1153fe076072e. 2023-03-14 14:53:15,054 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 14:53:15,055 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 14:53:15,055 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:15,055 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-03-14 14:53:15,055 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-03-14 14:53:15,056 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:15,056 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:15,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:15,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:15,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:15,057 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:15,057 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:53:15,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:15,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:15,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:15,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:15,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:15,058 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-03-14 14:53:15,058 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@36ad8cbb[Count = 0] remaining members to acquire global barrier 2023-03-14 14:53:15,058 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-03-14 14:53:15,058 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:15,060 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:15,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:15,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:15,061 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-03-14 14:53:15,061 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-03-14 14:53:15,061 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:53:15,061 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:15,061 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:53:15,062 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-03-14 14:53:15,062 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:15,062 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:53:15,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:15,062 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-03-14 14:53:15,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:15,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:15,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:15,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:15,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:15,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:15,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:15,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:15,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:15,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:53:15,066 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-03-14 14:53:15,066 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-03-14 14:53:15,066 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:53:15,066 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:53:15,066 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:15,066 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:53:15,067 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:15,067 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:15,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:15,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:15,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:15,068 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:15,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:15,068 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:53:15,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:15,068 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:15,068 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:53:15,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:53:15,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:15,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:15,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:15,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:15,069 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:15,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:15,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:15,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:15,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:15,071 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:53:15,071 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:15,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:53:15,071 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:53:15,072 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:53:15,071 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:15,072 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-03-14 14:53:15,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:53:15,072 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-03-14 14:53:15,072 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:53:15,072 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:15,072 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:15,072 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:15,072 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:15,072 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:15,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:53:15,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:53:15,072 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-03-14 14:53:15,072 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:53:15,173 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:53:15,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:53:15,178 DEBUG [Listener at localhost.localdomain/44261] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-03-14 14:53:15,181 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:49760, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-03-14 14:53:15,182 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=38031] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:15,197 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-03-14 14:53:15,198 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-03-14 14:53:15,200 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-14 14:53:15,200 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=12, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678806195200 2023-03-14 14:53:15,202 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-14 14:53:15,207 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-03-14 14:53:15,207 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-14 14:53:15,207 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] zookeeper.ReadOnlyZKClient(139): Connect 0x0dc02ef1 to 127.0.0.1:50211 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-14 14:53:15,253 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@24ddda5c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-14 14:53:15,261 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-14 14:53:15,818 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103b5fe871e54a54c5cb4317817a8310e5a to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103b5fe871e54a54c5cb4317817a8310e5a 2023-03-14 14:53:15,820 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-14 14:53:15,837 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-14 14:53:15,839 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:55412, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-14 14:53:15,850 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-14 14:53:15,852 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:49766, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-14 14:53:15,884 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/441ca9dfc6bf4dad9832824608f1b65b first=Optional[r3] last=Optional[r6] 2023-03-14 14:53:15,895 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1678805586057.0b22b7f42a887fbc05e1153fe076072e., hostname=jenkins-hbase20.apache.org,41317,1678805580877, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/441ca9dfc6bf4dad9832824608f1b65b}] 2023-03-14 14:53:15,910 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/441ca9dfc6bf4dad9832824608f1b65b for inclusion in 0b22b7f42a887fbc05e1153fe076072e/family1 2023-03-14 14:53:15,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-03-14 14:53:15,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(777): Region bounds: first= last= 2023-03-14 14:53:15,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HRegion(2446): Flush status journal for 0b22b7f42a887fbc05e1153fe076072e: 2023-03-14 14:53:15,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/441ca9dfc6bf4dad9832824608f1b65b to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__8bfne2dorj7o1hl2n2538g6rbaakue8k47s9oq6e2qoh0s66i0d760o9i1pf2bji/family1/441ca9dfc6bf4dad9832824608f1b65b 2023-03-14 14:53:15,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__8bfne2dorj7o1hl2n2538g6rbaakue8k47s9oq6e2qoh0s66i0d760o9i1pf2bji/family1/441ca9dfc6bf4dad9832824608f1b65b as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/204542a9fb7c42eab14926deda25d1d3_SeqId_44_ 2023-03-14 14:53:15,923 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__8bfne2dorj7o1hl2n2538g6rbaakue8k47s9oq6e2qoh0s66i0d760o9i1pf2bji/family1/441ca9dfc6bf4dad9832824608f1b65b into 0b22b7f42a887fbc05e1153fe076072e/family1 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/204542a9fb7c42eab14926deda25d1d3_SeqId_44_ - updating store file list. 2023-03-14 14:53:15,928 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/204542a9fb7c42eab14926deda25d1d3_SeqId_44_ into 0b22b7f42a887fbc05e1153fe076072e/family1 2023-03-14 14:53:15,928 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__8bfne2dorj7o1hl2n2538g6rbaakue8k47s9oq6e2qoh0s66i0d760o9i1pf2bji/family1/441ca9dfc6bf4dad9832824608f1b65b into 0b22b7f42a887fbc05e1153fe076072e/family1 (new location: hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/204542a9fb7c42eab14926deda25d1d3_SeqId_44_) 2023-03-14 14:53:15,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__8bfne2dorj7o1hl2n2538g6rbaakue8k47s9oq6e2qoh0s66i0d760o9i1pf2bji/family1/441ca9dfc6bf4dad9832824608f1b65b 2023-03-14 14:53:15,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-14 14:53:15,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51357 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-14 14:53:15,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(1912): 0b22b7f42a887fbc05e1153fe076072e/family1 is initiating minor compaction 2023-03-14 14:53:15,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@4b02a230; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-14 14:53:15,940 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 0b22b7f42a887fbc05e1153fe076072e/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1678805586057.0b22b7f42a887fbc05e1153fe076072e. 2023-03-14 14:53:15,941 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/abec8f5598174992a6efaa949aa3d83b, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/43f9abba38754c15b93707392ec36a81, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/afce427f062b42769f54843d77d1b74c, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/fbb9c9195dc743c097f58346447d2a90, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/05bd611ab6bb4f7a8e346336976b5c44, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/d74875e675ed4348a3d422ce616aaa62, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/2aab3d77db42464fb5f9e1c2c46874d7, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/ca3f7f64bb874e7ba92cb50f46a66c83, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/9567951d75ae415c91a0cccd38b57de3, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/204542a9fb7c42eab14926deda25d1d3_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/.tmp, totalSize=50.2 K 2023-03-14 14:53:15,941 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting abec8f5598174992a6efaa949aa3d83b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-14 14:53:15,941 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting 43f9abba38754c15b93707392ec36a81, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-14 14:53:15,941 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting afce427f062b42769f54843d77d1b74c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-14 14:53:15,941 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting fbb9c9195dc743c097f58346447d2a90, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-14 14:53:15,941 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting 05bd611ab6bb4f7a8e346336976b5c44, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-14 14:53:15,941 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting d74875e675ed4348a3d422ce616aaa62, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-14 14:53:15,941 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting 2aab3d77db42464fb5f9e1c2c46874d7, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-14 14:53:15,942 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting ca3f7f64bb874e7ba92cb50f46a66c83, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-14 14:53:15,942 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting 9567951d75ae415c91a0cccd38b57de3, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-14 14:53:15,942 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting 204542a9fb7c42eab14926deda25d1d3_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-14 14:53:15,956 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-14 14:53:15,958 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 14:53:15,964 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228ab0b80aabd83489fb0cb75c67f37d67d to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228ab0b80aabd83489fb0cb75c67f37d67d 2023-03-14 14:53:15,966 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231065d13f8534640b5821ea8d31a460bdc to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231065d13f8534640b5821ea8d31a460bdc 2023-03-14 14:53:15,968 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010169f11ba93bd0413c8698a62349b2b481 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010169f11ba93bd0413c8698a62349b2b481 2023-03-14 14:53:15,970 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103bb07415425364d8a8d0aae650fee2382 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103bb07415425364d8a8d0aae650fee2382 2023-03-14 14:53:15,970 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 4 expired mob files are deleted 2023-03-14 14:53:15,970 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-03-14 14:53:15,970 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-14 14:53:15,970 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-14 14:53:15,971 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-14 14:53:15,971 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-14 14:53:15,971 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-14 14:53:15,971 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-14 14:53:15,971 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-14 14:53:15,971 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-14 14:53:16,023 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] throttle.PressureAwareThroughputController(145): 0b22b7f42a887fbc05e1153fe076072e#family1#compaction#10 average throughput is 0.18 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-14 14:53:16,459 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/.tmp/family1/f1f7d47902104e5c92f44e9e24509e5f as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/f1f7d47902104e5c92f44e9e24509e5f 2023-03-14 14:53:16,493 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 0b22b7f42a887fbc05e1153fe076072e/family1 of 0b22b7f42a887fbc05e1153fe076072e into f1f7d47902104e5c92f44e9e24509e5f(size=6.6 K), total size for store is 182.5 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-14 14:53:16,493 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 0b22b7f42a887fbc05e1153fe076072e: 2023-03-14 14:53:16,494 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1678805586057.0b22b7f42a887fbc05e1153fe076072e., storeName=family1, fileCount=10, fileSize=50.2 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.5 K), priority=2, time=1678805595938; duration=0sec 2023-03-14 14:53:16,496 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-14 14:53:16,530 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/abec8f5598174992a6efaa949aa3d83b, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/43f9abba38754c15b93707392ec36a81, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/afce427f062b42769f54843d77d1b74c, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/fbb9c9195dc743c097f58346447d2a90, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/05bd611ab6bb4f7a8e346336976b5c44, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/d74875e675ed4348a3d422ce616aaa62, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/2aab3d77db42464fb5f9e1c2c46874d7, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/ca3f7f64bb874e7ba92cb50f46a66c83, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/9567951d75ae415c91a0cccd38b57de3, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/204542a9fb7c42eab14926deda25d1d3_SeqId_44_] to archive 2023-03-14 14:53:16,532 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 14:53:16,536 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/abec8f5598174992a6efaa949aa3d83b to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/abec8f5598174992a6efaa949aa3d83b 2023-03-14 14:53:16,544 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/43f9abba38754c15b93707392ec36a81 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/43f9abba38754c15b93707392ec36a81 2023-03-14 14:53:16,552 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/afce427f062b42769f54843d77d1b74c to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/afce427f062b42769f54843d77d1b74c 2023-03-14 14:53:16,554 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/fbb9c9195dc743c097f58346447d2a90 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/fbb9c9195dc743c097f58346447d2a90 2023-03-14 14:53:16,557 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/05bd611ab6bb4f7a8e346336976b5c44 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/05bd611ab6bb4f7a8e346336976b5c44 2023-03-14 14:53:16,563 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/d74875e675ed4348a3d422ce616aaa62 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/d74875e675ed4348a3d422ce616aaa62 2023-03-14 14:53:16,566 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/2aab3d77db42464fb5f9e1c2c46874d7 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/2aab3d77db42464fb5f9e1c2c46874d7 2023-03-14 14:53:16,571 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/ca3f7f64bb874e7ba92cb50f46a66c83 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/ca3f7f64bb874e7ba92cb50f46a66c83 2023-03-14 14:53:16,573 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/9567951d75ae415c91a0cccd38b57de3 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/9567951d75ae415c91a0cccd38b57de3 2023-03-14 14:53:16,576 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/204542a9fb7c42eab14926deda25d1d3_SeqId_44_ to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/204542a9fb7c42eab14926deda25d1d3_SeqId_44_ 2023-03-14 14:53:16,900 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205f5d5cbc82b0f4391af4a423aa9c081f9 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205f5d5cbc82b0f4391af4a423aa9c081f9 2023-03-14 14:53:16,907 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-14 14:53:17,014 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/c19e3d81fbf34c7498bd0d0024881ceb first=Optional[r00] last=Optional[r2] 2023-03-14 14:53:17,017 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1678805586057.0b22b7f42a887fbc05e1153fe076072e., hostname=jenkins-hbase20.apache.org,41317,1678805580877, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/c19e3d81fbf34c7498bd0d0024881ceb}] 2023-03-14 14:53:17,023 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/c19e3d81fbf34c7498bd0d0024881ceb for inclusion in 0b22b7f42a887fbc05e1153fe076072e/family1 2023-03-14 14:53:17,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-03-14 14:53:17,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(777): Region bounds: first= last= 2023-03-14 14:53:17,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HRegion(2446): Flush status journal for 0b22b7f42a887fbc05e1153fe076072e: 2023-03-14 14:53:17,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/c19e3d81fbf34c7498bd0d0024881ceb to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__ntm6deqdau7b0bgoh3o1pt5kngame1vmmjvr95tgqson6tn2ou9r4qd2670b9edk/family1/c19e3d81fbf34c7498bd0d0024881ceb 2023-03-14 14:53:17,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__ntm6deqdau7b0bgoh3o1pt5kngame1vmmjvr95tgqson6tn2ou9r4qd2670b9edk/family1/c19e3d81fbf34c7498bd0d0024881ceb as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/fa425ce7c16043d5b4ab3a390c1c4888_SeqId_47_ 2023-03-14 14:53:17,042 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__ntm6deqdau7b0bgoh3o1pt5kngame1vmmjvr95tgqson6tn2ou9r4qd2670b9edk/family1/c19e3d81fbf34c7498bd0d0024881ceb into 0b22b7f42a887fbc05e1153fe076072e/family1 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/fa425ce7c16043d5b4ab3a390c1c4888_SeqId_47_ - updating store file list. 2023-03-14 14:53:17,059 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/fa425ce7c16043d5b4ab3a390c1c4888_SeqId_47_ into 0b22b7f42a887fbc05e1153fe076072e/family1 2023-03-14 14:53:17,059 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__ntm6deqdau7b0bgoh3o1pt5kngame1vmmjvr95tgqson6tn2ou9r4qd2670b9edk/family1/c19e3d81fbf34c7498bd0d0024881ceb into 0b22b7f42a887fbc05e1153fe076072e/family1 (new location: hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/fa425ce7c16043d5b4ab3a390c1c4888_SeqId_47_) 2023-03-14 14:53:17,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__ntm6deqdau7b0bgoh3o1pt5kngame1vmmjvr95tgqson6tn2ou9r4qd2670b9edk/family1/c19e3d81fbf34c7498bd0d0024881ceb 2023-03-14 14:53:17,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-14 14:53:17,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 367249 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-14 14:53:17,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(1912): 0b22b7f42a887fbc05e1153fe076072e/family1 is initiating minor compaction (all files) 2023-03-14 14:53:17,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@3514a619; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-14 14:53:17,063 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 0b22b7f42a887fbc05e1153fe076072e/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1678805586057.0b22b7f42a887fbc05e1153fe076072e. 2023-03-14 14:53:17,066 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/290b0fc69668439e956dc6e745d2b173, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/f1f7d47902104e5c92f44e9e24509e5f, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/fa425ce7c16043d5b4ab3a390c1c4888_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/.tmp, totalSize=358.6 K 2023-03-14 14:53:17,067 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting 290b0fc69668439e956dc6e745d2b173, keycount=1000, bloomtype=ROW, size=175.8 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878806007 2023-03-14 14:53:17,068 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting f1f7d47902104e5c92f44e9e24509e5f, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621206007 2023-03-14 14:53:17,069 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting fa425ce7c16043d5b4ab3a390c1c4888_SeqId_47_, keycount=1002, bloomtype=ROW, size=176.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878806007 2023-03-14 14:53:17,072 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-14 14:53:17,078 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 14:53:17,088 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015113056d3177767684cc896854d9ad4d2f344 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015113056d3177767684cc896854d9ad4d2f344 2023-03-14 14:53:17,096 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512010dd8bc92274a419686d5a5764be36a7f to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512010dd8bc92274a419686d5a5764be36a7f 2023-03-14 14:53:17,101 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205fb0467ec940f447ebbce3e4d8c189eab to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205fb0467ec940f447ebbce3e4d8c189eab 2023-03-14 14:53:17,101 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 3 expired mob files are deleted 2023-03-14 14:53:17,101 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-03-14 14:53:17,104 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-14 14:53:17,104 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-14 14:53:17,107 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-14 14:53:17,108 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=12, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-03-14 14:53:17,111 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 1.9200 sec 2023-03-14 14:53:17,191 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] throttle.PressureAwareThroughputController(145): 0b22b7f42a887fbc05e1153fe076072e#family1#compaction#11 average throughput is 2.20 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-14 14:53:17,341 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/.tmp/family1/6f547161270a4717a25ffe818a7d6977 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/6f547161270a4717a25ffe818a7d6977 2023-03-14 14:53:17,358 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 0b22b7f42a887fbc05e1153fe076072e/family1 of 0b22b7f42a887fbc05e1153fe076072e into 6f547161270a4717a25ffe818a7d6977(size=177.2 K), total size for store is 177.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-14 14:53:17,358 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 0b22b7f42a887fbc05e1153fe076072e: 2023-03-14 14:53:17,358 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1678805586057.0b22b7f42a887fbc05e1153fe076072e., storeName=family1, fileCount=3, fileSize=358.6 K (175.8 K, 6.6 K, 176.2 K), priority=2, time=1678805597063; duration=0sec 2023-03-14 14:53:17,358 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-14 14:53:17,416 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/290b0fc69668439e956dc6e745d2b173, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/f1f7d47902104e5c92f44e9e24509e5f, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/fa425ce7c16043d5b4ab3a390c1c4888_SeqId_47_] to archive 2023-03-14 14:53:17,420 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 14:53:17,423 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/290b0fc69668439e956dc6e745d2b173 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/290b0fc69668439e956dc6e745d2b173 2023-03-14 14:53:17,424 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/f1f7d47902104e5c92f44e9e24509e5f to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/f1f7d47902104e5c92f44e9e24509e5f 2023-03-14 14:53:17,426 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/fa425ce7c16043d5b4ab3a390c1c4888_SeqId_47_ to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/fa425ce7c16043d5b4ab3a390c1c4888_SeqId_47_ 2023-03-14 14:53:17,480 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.HMaster$12(2454): Client=jenkins//148.251.75.209 modify table testMajorCompactionWithWeeklyFollowedByMonthly from 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-03-14 14:53:17,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:17,908 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-03-14 14:53:17,909 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-03-14 14:53:17,909 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-03-14 14:53:17,914 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly}] 2023-03-14 14:53:17,929 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=0b22b7f42a887fbc05e1153fe076072e, REOPEN/MOVE}] 2023-03-14 14:53:17,930 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=0b22b7f42a887fbc05e1153fe076072e, REOPEN/MOVE 2023-03-14 14:53:17,931 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=0b22b7f42a887fbc05e1153fe076072e, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:17,931 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1678805586057.0b22b7f42a887fbc05e1153fe076072e.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1678805597931"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1678805597931"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678805597931"}]},"ts":"1678805597931"} 2023-03-14 14:53:17,934 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE; CloseRegionProcedure 0b22b7f42a887fbc05e1153fe076072e, server=jenkins-hbase20.apache.org,41317,1678805580877}] 2023-03-14 14:53:18,093 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 0b22b7f42a887fbc05e1153fe076072e 2023-03-14 14:53:18,093 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 0b22b7f42a887fbc05e1153fe076072e, disabling compactions & flushes 2023-03-14 14:53:18,093 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1678805586057.0b22b7f42a887fbc05e1153fe076072e. 2023-03-14 14:53:18,093 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1678805586057.0b22b7f42a887fbc05e1153fe076072e. 2023-03-14 14:53:18,093 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1678805586057.0b22b7f42a887fbc05e1153fe076072e. after waiting 0 ms 2023-03-14 14:53:18,093 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1678805586057.0b22b7f42a887fbc05e1153fe076072e. 2023-03-14 14:53:18,099 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-03-14 14:53:18,100 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1678805586057.0b22b7f42a887fbc05e1153fe076072e. 2023-03-14 14:53:18,100 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 0b22b7f42a887fbc05e1153fe076072e: 2023-03-14 14:53:18,100 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 0b22b7f42a887fbc05e1153fe076072e to self. 2023-03-14 14:53:18,102 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 0b22b7f42a887fbc05e1153fe076072e 2023-03-14 14:53:18,103 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=0b22b7f42a887fbc05e1153fe076072e, regionState=CLOSED 2023-03-14 14:53:18,103 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1678805586057.0b22b7f42a887fbc05e1153fe076072e.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1678805598103"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678805598103"}]},"ts":"1678805598103"} 2023-03-14 14:53:18,108 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-03-14 14:53:18,108 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; CloseRegionProcedure 0b22b7f42a887fbc05e1153fe076072e, server=jenkins-hbase20.apache.org,41317,1678805580877 in 171 msec 2023-03-14 14:53:18,109 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=0b22b7f42a887fbc05e1153fe076072e, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase20.apache.org,41317,1678805580877; forceNewPlan=false, retain=true 2023-03-14 14:53:18,259 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=0b22b7f42a887fbc05e1153fe076072e, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:18,260 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1678805586057.0b22b7f42a887fbc05e1153fe076072e.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1678805598259"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1678805598259"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678805598259"}]},"ts":"1678805598259"} 2023-03-14 14:53:18,263 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=15, state=RUNNABLE; OpenRegionProcedure 0b22b7f42a887fbc05e1153fe076072e, server=jenkins-hbase20.apache.org,41317,1678805580877}] 2023-03-14 14:53:18,420 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1678805586057.0b22b7f42a887fbc05e1153fe076072e. 2023-03-14 14:53:18,421 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0b22b7f42a887fbc05e1153fe076072e, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1678805586057.0b22b7f42a887fbc05e1153fe076072e.', STARTKEY => '', ENDKEY => ''} 2023-03-14 14:53:18,421 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 0b22b7f42a887fbc05e1153fe076072e 2023-03-14 14:53:18,421 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1678805586057.0b22b7f42a887fbc05e1153fe076072e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 14:53:18,421 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 0b22b7f42a887fbc05e1153fe076072e 2023-03-14 14:53:18,421 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 0b22b7f42a887fbc05e1153fe076072e 2023-03-14 14:53:18,423 INFO [StoreOpener-0b22b7f42a887fbc05e1153fe076072e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 0b22b7f42a887fbc05e1153fe076072e 2023-03-14 14:53:18,424 DEBUG [StoreOpener-0b22b7f42a887fbc05e1153fe076072e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1 2023-03-14 14:53:18,425 DEBUG [StoreOpener-0b22b7f42a887fbc05e1153fe076072e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1 2023-03-14 14:53:18,425 INFO [StoreOpener-0b22b7f42a887fbc05e1153fe076072e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0b22b7f42a887fbc05e1153fe076072e columnFamilyName family1 2023-03-14 14:53:18,434 DEBUG [StoreOpener-0b22b7f42a887fbc05e1153fe076072e-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/6f547161270a4717a25ffe818a7d6977 2023-03-14 14:53:18,434 INFO [StoreOpener-0b22b7f42a887fbc05e1153fe076072e-1] regionserver.HStore(310): Store=0b22b7f42a887fbc05e1153fe076072e/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 14:53:18,436 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e 2023-03-14 14:53:18,437 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e 2023-03-14 14:53:18,443 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 0b22b7f42a887fbc05e1153fe076072e 2023-03-14 14:53:18,444 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 0b22b7f42a887fbc05e1153fe076072e; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69784475, jitterRate=0.03986971080303192}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-14 14:53:18,444 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 0b22b7f42a887fbc05e1153fe076072e: 2023-03-14 14:53:18,445 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1678805586057.0b22b7f42a887fbc05e1153fe076072e., pid=17, masterSystemTime=1678805598416 2023-03-14 14:53:18,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1678805586057.0b22b7f42a887fbc05e1153fe076072e. 2023-03-14 14:53:18,448 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1678805586057.0b22b7f42a887fbc05e1153fe076072e. 2023-03-14 14:53:18,449 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=0b22b7f42a887fbc05e1153fe076072e, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:18,449 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1678805586057.0b22b7f42a887fbc05e1153fe076072e.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1678805598448"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1678805598448"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678805598448"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678805598448"}]},"ts":"1678805598448"} 2023-03-14 14:53:18,455 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=15 2023-03-14 14:53:18,455 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=15, state=SUCCESS; OpenRegionProcedure 0b22b7f42a887fbc05e1153fe076072e, server=jenkins-hbase20.apache.org,41317,1678805580877 in 189 msec 2023-03-14 14:53:18,458 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-03-14 14:53:18,458 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=0b22b7f42a887fbc05e1153fe076072e, REOPEN/MOVE in 526 msec 2023-03-14 14:53:18,463 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=13 2023-03-14 14:53:18,463 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=13, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 548 msec 2023-03-14 14:53:18,466 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 981 msec 2023-03-14 14:53:18,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=13 2023-03-14 14:53:18,479 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(278): alter status finished 2023-03-14 14:53:18,480 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=38031] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-03-14 14:53:18,482 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-03-14 14:53:18,490 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-03-14 14:53:18,491 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678806198491 2023-03-14 14:53:18,492 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-14 14:53:18,493 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-14 14:53:18,494 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-03-14 14:53:18,495 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-14 14:53:18,495 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] zookeeper.ReadOnlyZKClient(139): Connect 0x4826e5a2 to 127.0.0.1:50211 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-14 14:53:18,512 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2e910200, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-14 14:53:18,512 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-14 14:53:18,512 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-14 14:53:18,512 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-14 14:53:18,512 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-14 14:53:18,512 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-14 14:53:19,368 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128fd65b2ce41514b93ad14fb29ae8d3fab to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128fd65b2ce41514b93ad14fb29ae8d3fab 2023-03-14 14:53:19,373 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-14 14:53:19,386 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-14 14:53:19,388 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:55414, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-14 14:53:19,399 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-14 14:53:19,402 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:49768, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-14 14:53:19,421 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/d6ffab6aae0c4aacbee8179db8d14cb5 first=Optional[r05] last=Optional[r8] 2023-03-14 14:53:19,422 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1678805586057.0b22b7f42a887fbc05e1153fe076072e., hostname=jenkins-hbase20.apache.org,41317,1678805580877, seqNum=51 for row with hfile group [{family1,hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/d6ffab6aae0c4aacbee8179db8d14cb5}] 2023-03-14 14:53:19,429 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/d6ffab6aae0c4aacbee8179db8d14cb5 for inclusion in 0b22b7f42a887fbc05e1153fe076072e/family1 2023-03-14 14:53:19,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-03-14 14:53:19,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HStore(777): Region bounds: first= last= 2023-03-14 14:53:19,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HRegion(2446): Flush status journal for 0b22b7f42a887fbc05e1153fe076072e: 2023-03-14 14:53:19,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/d6ffab6aae0c4aacbee8179db8d14cb5 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__l3k78m8f0rpbh1f3f0n59braf23egabob74j3m92ga2gku71t78rq2jej53d6rr9/family1/d6ffab6aae0c4aacbee8179db8d14cb5 2023-03-14 14:53:19,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__l3k78m8f0rpbh1f3f0n59braf23egabob74j3m92ga2gku71t78rq2jej53d6rr9/family1/d6ffab6aae0c4aacbee8179db8d14cb5 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/e6d90bdd13ef462faa3691ce625efc6a_SeqId_53_ 2023-03-14 14:53:19,441 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__l3k78m8f0rpbh1f3f0n59braf23egabob74j3m92ga2gku71t78rq2jej53d6rr9/family1/d6ffab6aae0c4aacbee8179db8d14cb5 into 0b22b7f42a887fbc05e1153fe076072e/family1 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/e6d90bdd13ef462faa3691ce625efc6a_SeqId_53_ - updating store file list. 2023-03-14 14:53:19,450 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/e6d90bdd13ef462faa3691ce625efc6a_SeqId_53_ into 0b22b7f42a887fbc05e1153fe076072e/family1 2023-03-14 14:53:19,450 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__l3k78m8f0rpbh1f3f0n59braf23egabob74j3m92ga2gku71t78rq2jej53d6rr9/family1/d6ffab6aae0c4aacbee8179db8d14cb5 into 0b22b7f42a887fbc05e1153fe076072e/family1 (new location: hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/family1/e6d90bdd13ef462faa3691ce625efc6a_SeqId_53_) 2023-03-14 14:53:19,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__l3k78m8f0rpbh1f3f0n59braf23egabob74j3m92ga2gku71t78rq2jej53d6rr9/family1/d6ffab6aae0c4aacbee8179db8d14cb5 2023-03-14 14:53:19,454 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-14 14:53:19,455 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 14:53:19,457 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112063e92e0796b64e64b1403f609a82ecd4 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112063e92e0796b64e64b1403f609a82ecd4 2023-03-14 14:53:19,459 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112808937504b81a42adadeae654d9f4f48e to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112808937504b81a42adadeae654d9f4f48e 2023-03-14 14:53:19,459 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 2 expired mob files are deleted 2023-03-14 14:53:19,459 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-03-14 14:53:19,460 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-14 14:53:19,460 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-14 14:53:19,460 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-03-14 14:53:19,461 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-03-14 14:53:19,461 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-14 14:53:19,462 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-03-14 14:53:19,464 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 981 msec 2023-03-14 14:53:19,553 INFO [Listener at localhost.localdomain/44261] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=248 (was 210) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1767526330_15 at /127.0.0.1:47882 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1767526330_15 at /127.0.0.1:47784 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x32ea605a-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x32ea605a-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-800586564_15 at /127.0.0.1:47966 [Waiting for operation #15] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobCompactor-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50211@0x4826e5a2-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1767526330_15 at /127.0.0.1:47870 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1767526330_15 at /127.0.0.1:47952 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x32ea605a-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1767526330_15 at /127.0.0.1:47822 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1767526330_15 at /127.0.0.1:47924 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1767526330_15 at /127.0.0.1:47798 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RSProcedureDispatcher-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50211@0x0dc02ef1-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50211@0x0dc02ef1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/105092891.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1767526330_15 at /127.0.0.1:47810 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1767526330_15 at /127.0.0.1:47990 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1767526330_15 at /127.0.0.1:47746 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1767526330_15 at /127.0.0.1:47984 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x30d3cb51-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50211@0x0dc02ef1-SendThread(127.0.0.1:50211) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1767526330_15 at /127.0.0.1:47716 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50211@0x4826e5a2-SendThread(127.0.0.1:50211) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50211@0x4826e5a2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/105092891.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1767526330_15 at /127.0.0.1:47838 [Waiting for operation #25] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1767526330_15 at /127.0.0.1:47938 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x30d3cb51-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1767526330_15 at /127.0.0.1:47772 [Waiting for operation #14] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS:0;jenkins-hbase20:41317-shortCompactions-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:549) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=593 (was 475) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=373 (was 389), ProcessCount=167 (was 167), AvailableMemoryMB=12742 (was 13154) 2023-03-14 14:53:19,568 INFO [Listener at localhost.localdomain/44261] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=248, OpenFileDescriptor=593, MaxFileDescriptor=60000, SystemLoadAverage=373, ProcessCount=167, AvailableMemoryMB=12741 2023-03-14 14:53:19,570 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-03-14 14:53:19,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:19,573 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-03-14 14:53:19,573 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithMonthlyPolicy" procId is: 19 2023-03-14 14:53:19,574 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-14 14:53:19,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-03-14 14:53:19,576 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3 2023-03-14 14:53:19,577 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3 empty. 2023-03-14 14:53:19,577 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3 2023-03-14 14:53:19,577 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithMonthlyPolicy regions 2023-03-14 14:53:19,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-03-14 14:53:19,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-03-14 14:53:19,993 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-03-14 14:53:19,995 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 97b71e93d23ff8810dbd42b157c10dd3, NAME => 'testMajorCompactionWithMonthlyPolicy,,1678805599570.97b71e93d23ff8810dbd42b157c10dd3.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp 2023-03-14 14:53:20,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-03-14 14:53:20,405 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1678805599570.97b71e93d23ff8810dbd42b157c10dd3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 14:53:20,405 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing 97b71e93d23ff8810dbd42b157c10dd3, disabling compactions & flushes 2023-03-14 14:53:20,405 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1678805599570.97b71e93d23ff8810dbd42b157c10dd3. 2023-03-14 14:53:20,405 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1678805599570.97b71e93d23ff8810dbd42b157c10dd3. 2023-03-14 14:53:20,405 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1678805599570.97b71e93d23ff8810dbd42b157c10dd3. after waiting 0 ms 2023-03-14 14:53:20,405 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1678805599570.97b71e93d23ff8810dbd42b157c10dd3. 2023-03-14 14:53:20,405 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1678805599570.97b71e93d23ff8810dbd42b157c10dd3. 2023-03-14 14:53:20,405 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 97b71e93d23ff8810dbd42b157c10dd3: 2023-03-14 14:53:20,408 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-03-14 14:53:20,409 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithMonthlyPolicy,,1678805599570.97b71e93d23ff8810dbd42b157c10dd3.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1678805600409"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678805600409"}]},"ts":"1678805600409"} 2023-03-14 14:53:20,411 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-14 14:53:20,412 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-14 14:53:20,413 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678805600412"}]},"ts":"1678805600412"} 2023-03-14 14:53:20,414 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-03-14 14:53:20,417 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=97b71e93d23ff8810dbd42b157c10dd3, ASSIGN}] 2023-03-14 14:53:20,419 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=97b71e93d23ff8810dbd42b157c10dd3, ASSIGN 2023-03-14 14:53:20,421 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=97b71e93d23ff8810dbd42b157c10dd3, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,41317,1678805580877; forceNewPlan=false, retain=false 2023-03-14 14:53:20,572 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=97b71e93d23ff8810dbd42b157c10dd3, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:20,573 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithMonthlyPolicy,,1678805599570.97b71e93d23ff8810dbd42b157c10dd3.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1678805600572"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1678805600572"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678805600572"}]},"ts":"1678805600572"} 2023-03-14 14:53:20,576 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=20, state=RUNNABLE; OpenRegionProcedure 97b71e93d23ff8810dbd42b157c10dd3, server=jenkins-hbase20.apache.org,41317,1678805580877}] 2023-03-14 14:53:20,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-03-14 14:53:20,732 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithMonthlyPolicy,,1678805599570.97b71e93d23ff8810dbd42b157c10dd3. 2023-03-14 14:53:20,733 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 97b71e93d23ff8810dbd42b157c10dd3, NAME => 'testMajorCompactionWithMonthlyPolicy,,1678805599570.97b71e93d23ff8810dbd42b157c10dd3.', STARTKEY => '', ENDKEY => ''} 2023-03-14 14:53:20,733 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithMonthlyPolicy 97b71e93d23ff8810dbd42b157c10dd3 2023-03-14 14:53:20,733 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1678805599570.97b71e93d23ff8810dbd42b157c10dd3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 14:53:20,733 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 97b71e93d23ff8810dbd42b157c10dd3 2023-03-14 14:53:20,733 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 97b71e93d23ff8810dbd42b157c10dd3 2023-03-14 14:53:20,735 INFO [StoreOpener-97b71e93d23ff8810dbd42b157c10dd3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 97b71e93d23ff8810dbd42b157c10dd3 2023-03-14 14:53:20,737 DEBUG [StoreOpener-97b71e93d23ff8810dbd42b157c10dd3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1 2023-03-14 14:53:20,737 DEBUG [StoreOpener-97b71e93d23ff8810dbd42b157c10dd3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1 2023-03-14 14:53:20,738 INFO [StoreOpener-97b71e93d23ff8810dbd42b157c10dd3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 97b71e93d23ff8810dbd42b157c10dd3 columnFamilyName family1 2023-03-14 14:53:20,745 INFO [StoreOpener-97b71e93d23ff8810dbd42b157c10dd3-1] regionserver.HStore(310): Store=97b71e93d23ff8810dbd42b157c10dd3/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 14:53:20,747 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3 2023-03-14 14:53:20,747 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3 2023-03-14 14:53:20,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 97b71e93d23ff8810dbd42b157c10dd3 2023-03-14 14:53:20,758 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-14 14:53:20,759 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 97b71e93d23ff8810dbd42b157c10dd3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70991186, jitterRate=0.05785110592842102}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-14 14:53:20,759 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 97b71e93d23ff8810dbd42b157c10dd3: 2023-03-14 14:53:20,760 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithMonthlyPolicy,,1678805599570.97b71e93d23ff8810dbd42b157c10dd3., pid=21, masterSystemTime=1678805600729 2023-03-14 14:53:20,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithMonthlyPolicy,,1678805599570.97b71e93d23ff8810dbd42b157c10dd3. 2023-03-14 14:53:20,766 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithMonthlyPolicy,,1678805599570.97b71e93d23ff8810dbd42b157c10dd3. 2023-03-14 14:53:20,767 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=97b71e93d23ff8810dbd42b157c10dd3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:20,767 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithMonthlyPolicy,,1678805599570.97b71e93d23ff8810dbd42b157c10dd3.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1678805600767"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1678805600767"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678805600767"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678805600767"}]},"ts":"1678805600767"} 2023-03-14 14:53:20,771 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=20 2023-03-14 14:53:20,771 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=20, state=SUCCESS; OpenRegionProcedure 97b71e93d23ff8810dbd42b157c10dd3, server=jenkins-hbase20.apache.org,41317,1678805580877 in 193 msec 2023-03-14 14:53:20,774 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=20, resume processing ppid=19 2023-03-14 14:53:20,774 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=19, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=97b71e93d23ff8810dbd42b157c10dd3, ASSIGN in 354 msec 2023-03-14 14:53:20,775 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-14 14:53:20,775 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678805600775"}]},"ts":"1678805600775"} 2023-03-14 14:53:20,776 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-03-14 14:53:20,783 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-03-14 14:53:20,786 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy in 1.2130 sec 2023-03-14 14:53:21,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-03-14 14:53:21,682 INFO [Listener at localhost.localdomain/44261] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithMonthlyPolicy, procId: 19 completed 2023-03-14 14:53:21,713 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:53:21,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:21,715 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-14 14:53:21,715 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:53:21,716 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-14 14:53:21,716 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-14 14:53:21,717 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:21,717 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:21,717 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:21,718 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:53:21,718 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:53:21,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:53:21,718 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:21,718 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:53:21,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:21,718 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:21,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:53:21,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:21,719 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:21,719 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:21,719 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-14 14:53:21,719 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:53:21,720 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-14 14:53:21,720 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 14:53:21,720 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:53:21,720 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1678805599570.97b71e93d23ff8810dbd42b157c10dd3. 2023-03-14 14:53:21,720 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1678805599570.97b71e93d23ff8810dbd42b157c10dd3. started... 2023-03-14 14:53:21,721 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 97b71e93d23ff8810dbd42b157c10dd3 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-14 14:53:21,748 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130b2a3a52963994110b8e3812146430c66 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130b2a3a52963994110b8e3812146430c66 2023-03-14 14:53:21,794 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithMonthlyPolicy' 2023-03-14 14:53:22,153 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/.tmp/family1/8b5c2f1719d4444489e8c27aa0329450 2023-03-14 14:53:22,160 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/.tmp/family1/8b5c2f1719d4444489e8c27aa0329450 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/8b5c2f1719d4444489e8c27aa0329450 2023-03-14 14:53:22,166 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/8b5c2f1719d4444489e8c27aa0329450, entries=1000, sequenceid=5, filesize=166.0 K 2023-03-14 14:53:22,167 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 97b71e93d23ff8810dbd42b157c10dd3 in 447ms, sequenceid=5, compaction requested=false 2023-03-14 14:53:22,168 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 97b71e93d23ff8810dbd42b157c10dd3: 2023-03-14 14:53:22,168 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1678805599570.97b71e93d23ff8810dbd42b157c10dd3. 2023-03-14 14:53:22,168 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 14:53:22,168 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 14:53:22,168 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:22,168 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-14 14:53:22,168 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-14 14:53:22,169 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:22,169 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:22,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:22,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:22,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:22,170 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:22,170 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:53:22,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:22,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:22,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:22,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:22,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:22,175 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-14 14:53:22,175 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1b6e9fb9[Count = 0] remaining members to acquire global barrier 2023-03-14 14:53:22,175 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-14 14:53:22,175 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:22,185 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:22,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:22,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:22,185 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-14 14:53:22,185 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-14 14:53:22,185 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:53:22,185 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:22,185 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:53:22,189 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-14 14:53:22,189 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:22,189 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:53:22,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:22,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:22,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:22,189 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-14 14:53:22,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:22,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:22,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:22,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:22,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:22,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:22,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:22,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:53:22,192 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-14 14:53:22,192 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-14 14:53:22,192 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:53:22,192 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:53:22,192 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:22,192 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:53:22,193 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:22,193 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:22,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:22,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:22,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:22,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:22,193 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:53:22,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:22,194 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:22,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:22,194 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:53:22,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:53:22,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:22,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:22,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:22,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:22,195 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:22,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:22,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:22,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:22,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:22,197 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:22,197 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:53:22,197 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:22,197 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:53:22,197 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:53:22,197 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:22,197 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:22,197 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:22,197 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:22,197 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:22,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:53:22,197 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-14 14:53:22,198 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:53:22,197 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:53:22,198 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:53:22,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:53:22,199 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-14 14:53:22,199 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-14 14:53:22,199 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:53:22,299 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:53:22,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:53:22,306 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:53:22,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-14 14:53:22,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:22,308 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-14 14:53:22,308 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:53:22,309 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-14 14:53:22,309 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-14 14:53:22,309 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:22,309 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:22,310 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:53:22,310 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:22,310 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:53:22,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:53:22,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:22,311 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:22,311 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:53:22,311 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:22,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:53:22,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:22,311 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:22,311 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-14 14:53:22,312 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:22,312 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-14 14:53:22,312 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:53:22,312 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-14 14:53:22,312 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 14:53:22,312 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:53:22,312 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1678805599570.97b71e93d23ff8810dbd42b157c10dd3. 2023-03-14 14:53:22,312 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1678805599570.97b71e93d23ff8810dbd42b157c10dd3. started... 2023-03-14 14:53:22,312 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 97b71e93d23ff8810dbd42b157c10dd3 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-14 14:53:22,729 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128bc0da0bcfe464707b6924dafe6d6d775 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151128bc0da0bcfe464707b6924dafe6d6d775 2023-03-14 14:53:23,141 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/.tmp/family1/9f2572585bb6411692a8b3548eb2a8db 2023-03-14 14:53:23,148 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/.tmp/family1/9f2572585bb6411692a8b3548eb2a8db as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/9f2572585bb6411692a8b3548eb2a8db 2023-03-14 14:53:23,154 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/9f2572585bb6411692a8b3548eb2a8db, entries=1, sequenceid=9, filesize=5.0 K 2023-03-14 14:53:23,155 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 97b71e93d23ff8810dbd42b157c10dd3 in 843ms, sequenceid=9, compaction requested=false 2023-03-14 14:53:23,155 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 97b71e93d23ff8810dbd42b157c10dd3: 2023-03-14 14:53:23,155 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1678805599570.97b71e93d23ff8810dbd42b157c10dd3. 2023-03-14 14:53:23,155 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 14:53:23,155 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 14:53:23,155 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:23,155 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-14 14:53:23,155 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-14 14:53:23,156 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:23,157 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:23,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:23,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:23,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:23,157 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:23,157 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:53:23,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:23,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:23,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:23,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:23,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:23,158 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-14 14:53:23,158 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@35adaee7[Count = 0] remaining members to acquire global barrier 2023-03-14 14:53:23,158 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-14 14:53:23,158 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:23,159 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:23,159 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:23,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:23,159 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-14 14:53:23,159 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-14 14:53:23,159 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:53:23,159 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:23,159 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:53:23,160 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:23,160 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-14 14:53:23,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:23,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:23,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:23,160 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:53:23,160 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-14 14:53:23,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:23,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:23,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:23,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:23,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:23,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:23,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:23,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:53:23,163 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-14 14:53:23,163 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-14 14:53:23,163 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:53:23,163 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:53:23,163 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:23,163 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:53:23,164 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:23,164 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:23,164 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:23,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:23,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:23,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:23,164 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:53:23,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:23,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:23,165 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:23,165 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:53:23,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:53:23,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:23,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:23,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:23,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:23,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:23,166 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:23,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:23,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:23,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:23,169 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:23,169 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:53:23,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:53:23,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:53:23,169 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:53:23,169 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:23,169 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-14 14:53:23,170 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:53:23,169 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:53:23,170 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:23,170 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:53:23,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:53:23,170 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:23,170 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:23,170 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:23,170 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-14 14:53:23,170 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:53:23,170 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:23,270 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:53:23,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:53:23,281 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:53:23,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-14 14:53:23,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:23,283 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-14 14:53:23,283 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:53:23,284 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-14 14:53:23,284 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-14 14:53:23,284 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:23,284 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:23,285 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:23,285 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:53:23,285 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:53:23,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:53:23,286 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:23,286 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:53:23,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:23,286 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:23,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:53:23,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:23,286 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:23,287 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-14 14:53:23,287 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:23,287 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-14 14:53:23,287 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:53:23,287 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-14 14:53:23,287 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 14:53:23,287 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:53:23,287 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1678805599570.97b71e93d23ff8810dbd42b157c10dd3. 2023-03-14 14:53:23,288 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1678805599570.97b71e93d23ff8810dbd42b157c10dd3. started... 2023-03-14 14:53:23,288 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 97b71e93d23ff8810dbd42b157c10dd3 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 14:53:23,626 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-14 14:53:23,710 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201371baeb8672b4918904592c1710c6485 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201371baeb8672b4918904592c1710c6485 2023-03-14 14:53:24,118 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/.tmp/family1/19540c3734e04de69e67e5621c27463b 2023-03-14 14:53:24,125 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/.tmp/family1/19540c3734e04de69e67e5621c27463b as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/19540c3734e04de69e67e5621c27463b 2023-03-14 14:53:24,131 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/19540c3734e04de69e67e5621c27463b, entries=1, sequenceid=13, filesize=4.9 K 2023-03-14 14:53:24,132 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 97b71e93d23ff8810dbd42b157c10dd3 in 844ms, sequenceid=13, compaction requested=true 2023-03-14 14:53:24,132 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 97b71e93d23ff8810dbd42b157c10dd3: 2023-03-14 14:53:24,132 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1678805599570.97b71e93d23ff8810dbd42b157c10dd3. 2023-03-14 14:53:24,132 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 14:53:24,132 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 14:53:24,132 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:24,132 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-14 14:53:24,132 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-14 14:53:24,133 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:24,133 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:24,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:24,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:24,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:24,134 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:24,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:24,134 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:53:24,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:24,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:24,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:24,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:24,135 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-14 14:53:24,135 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7ec41653[Count = 0] remaining members to acquire global barrier 2023-03-14 14:53:24,135 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-14 14:53:24,135 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:24,136 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:24,136 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:24,136 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:53:24,136 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:24,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:24,136 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-14 14:53:24,136 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-14 14:53:24,136 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:53:24,137 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-14 14:53:24,137 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:24,137 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:53:24,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:24,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:24,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:24,137 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-14 14:53:24,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:24,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:24,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:24,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:24,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:24,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:24,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:24,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:53:24,140 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-14 14:53:24,140 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-14 14:53:24,140 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:53:24,140 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:53:24,140 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:24,140 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:53:24,141 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:24,141 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:24,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:24,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:24,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:24,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:24,141 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:53:24,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:24,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:24,142 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:24,142 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:53:24,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:53:24,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:24,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:24,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:24,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:24,144 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:24,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:24,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:24,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:24,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:24,153 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:53:24,153 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:24,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:53:24,153 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:53:24,153 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-14 14:53:24,153 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:53:24,153 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-14 14:53:24,154 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:53:24,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:53:24,153 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:24,154 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:24,154 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:24,154 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:24,154 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:24,154 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:24,155 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-14 14:53:24,155 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:53:24,155 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:53:24,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:53:24,255 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:53:24,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:53:24,260 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:53:24,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-14 14:53:24,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:24,262 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-14 14:53:24,262 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:53:24,263 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-14 14:53:24,263 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-14 14:53:24,264 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:24,264 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:24,264 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:53:24,264 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:24,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:53:24,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:53:24,265 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:24,265 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:53:24,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:24,265 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:24,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:53:24,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:24,265 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:24,266 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-14 14:53:24,266 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:24,266 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-14 14:53:24,266 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:53:24,266 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-14 14:53:24,266 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 14:53:24,266 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:53:24,266 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1678805599570.97b71e93d23ff8810dbd42b157c10dd3. 2023-03-14 14:53:24,267 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1678805599570.97b71e93d23ff8810dbd42b157c10dd3. started... 2023-03-14 14:53:24,267 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 97b71e93d23ff8810dbd42b157c10dd3 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 14:53:24,686 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205d8dafebe96854f918cdad07f327c2d1a to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205d8dafebe96854f918cdad07f327c2d1a 2023-03-14 14:53:25,100 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/.tmp/family1/bd03d81c817549f585f9940e8422a03d 2023-03-14 14:53:25,107 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/.tmp/family1/bd03d81c817549f585f9940e8422a03d as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/bd03d81c817549f585f9940e8422a03d 2023-03-14 14:53:25,115 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/bd03d81c817549f585f9940e8422a03d, entries=1, sequenceid=17, filesize=4.9 K 2023-03-14 14:53:25,116 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 97b71e93d23ff8810dbd42b157c10dd3 in 849ms, sequenceid=17, compaction requested=true 2023-03-14 14:53:25,116 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 97b71e93d23ff8810dbd42b157c10dd3: 2023-03-14 14:53:25,116 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1678805599570.97b71e93d23ff8810dbd42b157c10dd3. 2023-03-14 14:53:25,116 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 14:53:25,116 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 14:53:25,116 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:25,116 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-14 14:53:25,116 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-14 14:53:25,117 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:25,117 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:25,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:25,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:25,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:25,118 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:25,118 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:53:25,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:25,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:25,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:25,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:25,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:25,119 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-14 14:53:25,119 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@24569564[Count = 0] remaining members to acquire global barrier 2023-03-14 14:53:25,119 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-14 14:53:25,119 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:25,120 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:25,120 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:25,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:25,120 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-14 14:53:25,120 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-14 14:53:25,120 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:53:25,120 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:25,120 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:53:25,121 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:25,121 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-14 14:53:25,121 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:53:25,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:25,121 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-14 14:53:25,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:25,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:25,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:25,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:25,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:25,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:25,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:25,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:25,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:25,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:53:25,126 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-14 14:53:25,126 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-14 14:53:25,126 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:53:25,126 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:53:25,126 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:25,126 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:53:25,143 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:25,143 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:25,143 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:53:25,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:25,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:25,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:25,143 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:25,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:25,143 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:25,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:25,144 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:53:25,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:53:25,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:25,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:25,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:25,145 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:25,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:25,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:25,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:25,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:25,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:25,151 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:53:25,151 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:25,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:53:25,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:53:25,151 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:25,152 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:25,152 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:25,152 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:25,152 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:25,152 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:25,151 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:53:25,151 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-14 14:53:25,152 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:53:25,152 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-14 14:53:25,152 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:53:25,151 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:53:25,155 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-14 14:53:25,155 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:53:25,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:53:25,253 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:53:25,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:53:25,259 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:53:25,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-14 14:53:25,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:25,261 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-14 14:53:25,261 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:53:25,261 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-14 14:53:25,261 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-14 14:53:25,262 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:25,262 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:25,263 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:25,263 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:53:25,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:53:25,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:53:25,263 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:25,263 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:53:25,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:25,263 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:25,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:53:25,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:25,264 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:25,265 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-14 14:53:25,266 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:25,266 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-14 14:53:25,266 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:53:25,266 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-14 14:53:25,267 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 14:53:25,267 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:53:25,267 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1678805599570.97b71e93d23ff8810dbd42b157c10dd3. 2023-03-14 14:53:25,267 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1678805599570.97b71e93d23ff8810dbd42b157c10dd3. started... 2023-03-14 14:53:25,267 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 97b71e93d23ff8810dbd42b157c10dd3 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 14:53:25,686 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015122862f41e28075d422a88ad587ded41d883 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015122862f41e28075d422a88ad587ded41d883 2023-03-14 14:53:25,694 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/.tmp/family1/ec555014c14d4eeb85d13f0ad9443f18 2023-03-14 14:53:25,701 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/.tmp/family1/ec555014c14d4eeb85d13f0ad9443f18 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/ec555014c14d4eeb85d13f0ad9443f18 2023-03-14 14:53:25,711 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/ec555014c14d4eeb85d13f0ad9443f18, entries=1, sequenceid=21, filesize=4.9 K 2023-03-14 14:53:25,712 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 97b71e93d23ff8810dbd42b157c10dd3 in 445ms, sequenceid=21, compaction requested=true 2023-03-14 14:53:25,712 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 97b71e93d23ff8810dbd42b157c10dd3: 2023-03-14 14:53:25,712 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1678805599570.97b71e93d23ff8810dbd42b157c10dd3. 2023-03-14 14:53:25,712 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 14:53:25,712 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 14:53:25,712 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:25,712 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-14 14:53:25,712 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-14 14:53:25,713 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:25,713 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:25,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:25,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:25,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:25,714 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:25,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:25,714 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:53:25,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:25,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:25,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:25,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:25,715 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-14 14:53:25,715 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4baa4500[Count = 0] remaining members to acquire global barrier 2023-03-14 14:53:25,715 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-14 14:53:25,715 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:25,716 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:25,716 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:25,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:25,716 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-14 14:53:25,717 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-14 14:53:25,717 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:53:25,717 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:25,717 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:53:25,718 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-14 14:53:25,718 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:53:25,718 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:25,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:25,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:25,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:25,718 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-14 14:53:25,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:25,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:25,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:25,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:25,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:25,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:25,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:25,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:53:25,724 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-14 14:53:25,724 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-14 14:53:25,725 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:53:25,725 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:53:25,725 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:25,725 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:53:25,739 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:25,739 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:25,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:25,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:25,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:25,739 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:53:25,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:25,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:25,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:25,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:53:25,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:53:25,740 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:25,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:25,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:25,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:25,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:25,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:25,741 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:25,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:25,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:25,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:25,743 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:25,743 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:25,744 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:25,744 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:25,744 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:25,744 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:53:25,744 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-14 14:53:25,745 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:53:25,744 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:25,745 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:25,745 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-14 14:53:25,745 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:53:25,745 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:53:25,745 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:53:25,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:53:25,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:53:25,746 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:53:25,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:53:25,845 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:53:25,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:53:25,853 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:53:25,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-14 14:53:25,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:25,855 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-14 14:53:25,855 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:53:25,856 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-14 14:53:25,856 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-14 14:53:25,856 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:25,856 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:25,858 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:53:25,858 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:25,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:53:25,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:53:25,858 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:25,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:25,859 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:53:25,859 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:25,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:53:25,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:25,859 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:25,859 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-14 14:53:25,859 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:25,860 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-14 14:53:25,860 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:53:25,860 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-14 14:53:25,860 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 14:53:25,861 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:53:25,861 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1678805599570.97b71e93d23ff8810dbd42b157c10dd3. 2023-03-14 14:53:25,861 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1678805599570.97b71e93d23ff8810dbd42b157c10dd3. started... 2023-03-14 14:53:25,861 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 97b71e93d23ff8810dbd42b157c10dd3 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 14:53:26,292 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512319fb1ca92d94248788f18b1dc0a3e7daf to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512319fb1ca92d94248788f18b1dc0a3e7daf 2023-03-14 14:53:26,299 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/.tmp/family1/d45b93a5590342a3a666803305e2f9ac 2023-03-14 14:53:26,307 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/.tmp/family1/d45b93a5590342a3a666803305e2f9ac as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/d45b93a5590342a3a666803305e2f9ac 2023-03-14 14:53:26,314 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/d45b93a5590342a3a666803305e2f9ac, entries=1, sequenceid=25, filesize=4.9 K 2023-03-14 14:53:26,315 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 97b71e93d23ff8810dbd42b157c10dd3 in 454ms, sequenceid=25, compaction requested=true 2023-03-14 14:53:26,315 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 97b71e93d23ff8810dbd42b157c10dd3: 2023-03-14 14:53:26,316 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1678805599570.97b71e93d23ff8810dbd42b157c10dd3. 2023-03-14 14:53:26,316 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 14:53:26,316 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 14:53:26,316 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:26,316 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-14 14:53:26,316 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-14 14:53:26,317 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:26,317 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:26,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:26,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:26,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:26,317 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:26,317 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:53:26,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:26,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:26,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:26,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:26,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:26,319 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-14 14:53:26,319 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@13281004[Count = 0] remaining members to acquire global barrier 2023-03-14 14:53:26,319 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-14 14:53:26,319 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:26,320 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:26,320 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:26,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:26,320 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-14 14:53:26,320 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-14 14:53:26,320 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:53:26,322 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:26,322 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:53:26,323 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:26,323 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-14 14:53:26,323 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:53:26,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:26,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:26,323 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-14 14:53:26,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:26,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:26,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:26,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:26,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:26,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:26,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:26,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:26,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:53:26,326 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-14 14:53:26,326 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-14 14:53:26,326 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:53:26,326 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:53:26,326 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:26,326 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:53:26,327 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:26,327 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:53:26,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:26,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:26,328 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:53:26,328 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:26,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:53:26,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:26,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:26,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:26,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:26,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:26,329 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:26,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:26,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:26,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:26,330 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:26,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:26,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:26,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:26,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:26,332 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:53:26,332 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:26,332 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:53:26,332 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:26,332 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:53:26,332 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-14 14:53:26,332 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:53:26,332 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-14 14:53:26,333 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:53:26,332 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:26,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:53:26,333 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:26,333 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:26,333 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:26,333 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:26,333 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-14 14:53:26,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:53:26,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:53:26,333 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:53:26,434 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:53:26,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:53:26,440 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:53:26,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-14 14:53:26,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:26,442 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-14 14:53:26,442 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:53:26,442 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-14 14:53:26,442 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-14 14:53:26,443 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:26,443 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:26,444 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:26,444 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:53:26,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:53:26,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:53:26,444 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:26,444 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:53:26,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:26,444 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:26,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:53:26,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:26,445 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:26,445 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-14 14:53:26,445 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:26,445 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-14 14:53:26,445 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:53:26,446 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-14 14:53:26,446 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 14:53:26,446 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:53:26,446 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1678805599570.97b71e93d23ff8810dbd42b157c10dd3. 2023-03-14 14:53:26,446 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1678805599570.97b71e93d23ff8810dbd42b157c10dd3. started... 2023-03-14 14:53:26,446 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 97b71e93d23ff8810dbd42b157c10dd3 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 14:53:26,871 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101baa5f709274046e285e7b8c780dd6652 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101baa5f709274046e285e7b8c780dd6652 2023-03-14 14:53:27,277 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/.tmp/family1/56d76262670941479eb8ea4a25faa84c 2023-03-14 14:53:27,286 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/.tmp/family1/56d76262670941479eb8ea4a25faa84c as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/56d76262670941479eb8ea4a25faa84c 2023-03-14 14:53:27,298 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/56d76262670941479eb8ea4a25faa84c, entries=1, sequenceid=29, filesize=4.9 K 2023-03-14 14:53:27,299 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 97b71e93d23ff8810dbd42b157c10dd3 in 853ms, sequenceid=29, compaction requested=true 2023-03-14 14:53:27,299 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 97b71e93d23ff8810dbd42b157c10dd3: 2023-03-14 14:53:27,299 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1678805599570.97b71e93d23ff8810dbd42b157c10dd3. 2023-03-14 14:53:27,299 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 14:53:27,299 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 14:53:27,299 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:27,299 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-14 14:53:27,299 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-14 14:53:27,301 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:27,301 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:27,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:27,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:27,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:27,301 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:27,301 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:53:27,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:27,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:27,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:27,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:27,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:27,304 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-14 14:53:27,304 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4d80fabc[Count = 0] remaining members to acquire global barrier 2023-03-14 14:53:27,304 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-14 14:53:27,304 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:27,305 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:27,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:27,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:27,305 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-14 14:53:27,305 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-14 14:53:27,305 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:53:27,306 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:27,306 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:53:27,307 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-14 14:53:27,307 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:27,307 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:53:27,307 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-14 14:53:27,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:27,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:27,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:27,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:27,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:27,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:27,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:27,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:27,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:27,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:27,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:53:27,320 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-14 14:53:27,320 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-14 14:53:27,320 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:53:27,320 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:53:27,320 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:27,320 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:53:27,324 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:27,324 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:27,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:27,324 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:53:27,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:27,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:27,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:27,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:27,325 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:27,325 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:53:27,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:53:27,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:27,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:27,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:27,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:27,327 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:27,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:27,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:27,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:27,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:27,339 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:53:27,339 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:53:27,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:53:27,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:53:27,339 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:27,339 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:53:27,339 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:27,340 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:27,340 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:27,340 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:27,340 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:27,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:53:27,339 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-14 14:53:27,340 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:53:27,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:53:27,340 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:27,341 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-14 14:53:27,341 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-14 14:53:27,341 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:53:27,441 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:53:27,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:53:27,452 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:53:27,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-14 14:53:27,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:27,454 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-14 14:53:27,454 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:53:27,455 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-14 14:53:27,455 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-14 14:53:27,455 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:27,455 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:27,456 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:27,456 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:53:27,456 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:53:27,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:53:27,456 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:27,456 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:53:27,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:27,457 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:27,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:53:27,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:27,457 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:27,458 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-14 14:53:27,458 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:27,458 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-14 14:53:27,458 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:53:27,458 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-14 14:53:27,458 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 14:53:27,458 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:53:27,458 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1678805599570.97b71e93d23ff8810dbd42b157c10dd3. 2023-03-14 14:53:27,458 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1678805599570.97b71e93d23ff8810dbd42b157c10dd3. started... 2023-03-14 14:53:27,459 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 97b71e93d23ff8810dbd42b157c10dd3 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 14:53:27,883 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103fb8c862efde946318f07dced348e8ce7 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103fb8c862efde946318f07dced348e8ce7 2023-03-14 14:53:27,889 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/.tmp/family1/ec8503140042471a8fa90d8e7aec6815 2023-03-14 14:53:27,895 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/.tmp/family1/ec8503140042471a8fa90d8e7aec6815 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/ec8503140042471a8fa90d8e7aec6815 2023-03-14 14:53:27,901 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/ec8503140042471a8fa90d8e7aec6815, entries=1, sequenceid=33, filesize=4.9 K 2023-03-14 14:53:27,902 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 97b71e93d23ff8810dbd42b157c10dd3 in 443ms, sequenceid=33, compaction requested=true 2023-03-14 14:53:27,902 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 97b71e93d23ff8810dbd42b157c10dd3: 2023-03-14 14:53:27,902 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1678805599570.97b71e93d23ff8810dbd42b157c10dd3. 2023-03-14 14:53:27,902 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 14:53:27,902 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 14:53:27,902 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:27,902 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-14 14:53:27,902 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-14 14:53:27,904 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:27,904 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:27,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:27,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:27,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:27,904 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:27,904 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:53:27,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:27,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:27,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:27,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:27,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:27,905 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-14 14:53:27,905 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5d6dbbdd[Count = 0] remaining members to acquire global barrier 2023-03-14 14:53:27,905 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-14 14:53:27,905 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:27,907 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:27,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:27,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:27,907 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-14 14:53:27,907 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-14 14:53:27,908 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:53:27,908 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:27,908 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:53:27,908 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-14 14:53:27,908 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:27,909 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:53:27,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:27,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:27,909 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-14 14:53:27,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:27,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:27,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:27,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:27,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:27,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:27,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:27,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:27,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:53:27,912 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-14 14:53:27,912 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-14 14:53:27,912 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:53:27,912 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:53:27,912 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:27,912 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:53:27,913 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:27,913 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:27,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:27,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:27,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:27,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:27,913 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:53:27,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:27,916 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:53:27,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:53:27,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:27,916 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:27,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:27,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:27,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:27,918 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:27,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:27,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:27,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:27,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:27,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:27,920 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:27,920 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:27,920 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:27,920 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:27,920 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:27,920 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:53:27,920 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-14 14:53:27,920 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:53:27,920 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:27,920 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:53:27,921 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:27,921 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:53:27,921 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-14 14:53:27,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:53:27,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:53:27,921 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-14 14:53:27,921 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:53:27,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:53:27,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:53:28,021 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:53:28,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:53:28,027 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:53:28,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-14 14:53:28,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:28,030 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-14 14:53:28,030 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:53:28,030 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-14 14:53:28,030 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-14 14:53:28,031 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:28,031 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:28,031 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:53:28,031 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:28,032 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:53:28,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:53:28,032 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:28,032 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:53:28,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:28,032 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:28,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:53:28,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:28,032 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:28,033 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-14 14:53:28,033 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:28,033 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-14 14:53:28,033 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:53:28,033 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-14 14:53:28,033 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 14:53:28,033 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:53:28,033 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1678805599570.97b71e93d23ff8810dbd42b157c10dd3. 2023-03-14 14:53:28,033 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1678805599570.97b71e93d23ff8810dbd42b157c10dd3. started... 2023-03-14 14:53:28,033 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 97b71e93d23ff8810dbd42b157c10dd3 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 14:53:28,454 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015090793f939b0f16d4f689d192f1759ec3878 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015090793f939b0f16d4f689d192f1759ec3878 2023-03-14 14:53:28,862 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/.tmp/family1/f5bb9a22fbec41dda7699a8fc45c436e 2023-03-14 14:53:28,875 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/.tmp/family1/f5bb9a22fbec41dda7699a8fc45c436e as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/f5bb9a22fbec41dda7699a8fc45c436e 2023-03-14 14:53:28,885 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/f5bb9a22fbec41dda7699a8fc45c436e, entries=1, sequenceid=37, filesize=4.9 K 2023-03-14 14:53:28,886 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 97b71e93d23ff8810dbd42b157c10dd3 in 853ms, sequenceid=37, compaction requested=true 2023-03-14 14:53:28,886 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 97b71e93d23ff8810dbd42b157c10dd3: 2023-03-14 14:53:28,886 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1678805599570.97b71e93d23ff8810dbd42b157c10dd3. 2023-03-14 14:53:28,886 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 14:53:28,886 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 14:53:28,886 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:28,886 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-14 14:53:28,886 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-14 14:53:28,888 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:28,888 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:28,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:28,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:28,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:28,888 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:28,888 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:53:28,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:28,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:28,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:28,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:28,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:28,889 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-14 14:53:28,889 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@44767735[Count = 0] remaining members to acquire global barrier 2023-03-14 14:53:28,889 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-14 14:53:28,889 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:28,890 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:28,890 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:28,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:28,890 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-14 14:53:28,890 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-14 14:53:28,890 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:28,890 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:53:28,890 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:53:28,891 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:28,891 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-14 14:53:28,891 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:53:28,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:28,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:28,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:28,891 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-14 14:53:28,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:28,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:28,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:28,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:28,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:28,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:28,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:28,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:53:28,894 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-14 14:53:28,894 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-14 14:53:28,894 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:53:28,895 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:53:28,895 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:28,895 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:53:28,896 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:28,896 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:53:28,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:28,896 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:28,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:28,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:28,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:28,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:28,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:53:28,896 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:28,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:28,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:53:28,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:28,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:28,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:28,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:28,897 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:28,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:28,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:28,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:28,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:28,899 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:28,899 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:53:28,899 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:53:28,899 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:28,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:53:28,899 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:28,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:53:28,899 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-14 14:53:28,899 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:53:28,899 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:53:28,899 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:28,899 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:28,899 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:28,899 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:28,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:53:28,899 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-14 14:53:28,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:53:28,900 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-14 14:53:28,900 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:53:29,000 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:53:29,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:53:29,009 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:53:29,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-14 14:53:29,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:29,012 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-03-14 14:53:29,012 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:53:29,013 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-14 14:53:29,013 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-14 14:53:29,014 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:29,014 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:29,015 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:29,015 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:53:29,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:53:29,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:53:29,015 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:29,015 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:53:29,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:29,016 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:29,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:53:29,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:29,016 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:29,016 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-03-14 14:53:29,016 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:29,016 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-14 14:53:29,016 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:53:29,018 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-14 14:53:29,018 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 14:53:29,018 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:53:29,018 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1678805599570.97b71e93d23ff8810dbd42b157c10dd3. 2023-03-14 14:53:29,018 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1678805599570.97b71e93d23ff8810dbd42b157c10dd3. started... 2023-03-14 14:53:29,018 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 97b71e93d23ff8810dbd42b157c10dd3 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 14:53:29,437 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112094cc48d9d68b47a28782393f61745f23 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015112094cc48d9d68b47a28782393f61745f23 2023-03-14 14:53:29,843 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/.tmp/family1/ba050b9b269940f58ff3af92078e1532 2023-03-14 14:53:29,857 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/.tmp/family1/ba050b9b269940f58ff3af92078e1532 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/ba050b9b269940f58ff3af92078e1532 2023-03-14 14:53:29,866 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/ba050b9b269940f58ff3af92078e1532, entries=1, sequenceid=41, filesize=4.9 K 2023-03-14 14:53:29,867 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 97b71e93d23ff8810dbd42b157c10dd3 in 849ms, sequenceid=41, compaction requested=true 2023-03-14 14:53:29,867 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 97b71e93d23ff8810dbd42b157c10dd3: 2023-03-14 14:53:29,867 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1678805599570.97b71e93d23ff8810dbd42b157c10dd3. 2023-03-14 14:53:29,867 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 14:53:29,867 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 14:53:29,867 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:29,867 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-03-14 14:53:29,867 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-03-14 14:53:29,868 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:29,868 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:29,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:29,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:29,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:29,869 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:29,869 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:53:29,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:29,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:29,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:29,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:29,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:29,870 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-03-14 14:53:29,870 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@170df78f[Count = 0] remaining members to acquire global barrier 2023-03-14 14:53:29,870 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-14 14:53:29,870 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:29,871 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:29,871 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:29,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:29,871 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-14 14:53:29,871 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-03-14 14:53:29,871 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:53:29,871 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:29,872 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:53:29,872 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:29,872 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-14 14:53:29,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:29,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:29,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:29,872 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:53:29,873 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-03-14 14:53:29,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:29,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:29,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:29,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:29,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:29,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:29,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:29,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:53:29,875 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-14 14:53:29,875 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-03-14 14:53:29,875 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:53:29,875 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:53:29,875 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:29,875 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:53:29,876 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:29,876 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:29,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:29,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:29,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:29,876 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:53:29,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:29,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:29,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:29,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:53:29,877 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:29,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:53:29,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:29,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:29,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:29,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:29,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:29,878 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:29,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:29,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:29,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:29,880 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:29,880 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:53:29,880 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:29,880 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:53:29,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:53:29,880 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:53:29,881 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-14 14:53:29,880 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-03-14 14:53:29,881 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:53:29,880 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:29,880 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:53:29,881 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:29,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:53:29,882 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-14 14:53:29,882 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:29,882 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:53:29,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:53:29,882 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:29,883 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:29,983 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:53:29,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:53:29,989 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=38031] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithMonthlyPolicy 2023-03-14 14:53:29,992 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] procedure2.ProcedureExecutor(1029): Stored pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-03-14 14:53:29,993 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-03-14 14:53:29,994 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-14 14:53:29,994 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=22, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678806209994 2023-03-14 14:53:29,995 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-14 14:53:29,997 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithMonthlyPolicy' and column 'family1' 2023-03-14 14:53:29,997 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-14 14:53:29,998 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] zookeeper.ReadOnlyZKClient(139): Connect 0x22c523d1 to 127.0.0.1:50211 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-14 14:53:30,003 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@462b48b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-14 14:53:30,004 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-14 14:53:30,843 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103db4b67bea7124598b051b533e1493f4b to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103db4b67bea7124598b051b533e1493f4b 2023-03-14 14:53:30,845 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-14 14:53:30,862 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-14 14:53:30,864 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:60988, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-14 14:53:30,872 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-14 14:53:30,873 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:42142, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-14 14:53:30,904 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/c3f2fb241c10436c830481cf516d7a8e first=Optional[r5] last=Optional[r6] 2023-03-14 14:53:30,904 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1678805599570.97b71e93d23ff8810dbd42b157c10dd3., hostname=jenkins-hbase20.apache.org,41317,1678805580877, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/c3f2fb241c10436c830481cf516d7a8e}] 2023-03-14 14:53:30,911 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/c3f2fb241c10436c830481cf516d7a8e for inclusion in 97b71e93d23ff8810dbd42b157c10dd3/family1 2023-03-14 14:53:30,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-03-14 14:53:30,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(777): Region bounds: first= last= 2023-03-14 14:53:30,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HRegion(2446): Flush status journal for 97b71e93d23ff8810dbd42b157c10dd3: 2023-03-14 14:53:30,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/c3f2fb241c10436c830481cf516d7a8e to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionWithMonthlyPolicy__s2ljjhjc0pq5arn21mjn8r0rqfjhmjm3gl6s4ceva98ttk9mher2s3tebpb73j0p/family1/c3f2fb241c10436c830481cf516d7a8e 2023-03-14 14:53:30,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionWithMonthlyPolicy__s2ljjhjc0pq5arn21mjn8r0rqfjhmjm3gl6s4ceva98ttk9mher2s3tebpb73j0p/family1/c3f2fb241c10436c830481cf516d7a8e as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/aee64428476a4635a56065d0cdbe34d3_SeqId_44_ 2023-03-14 14:53:30,921 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionWithMonthlyPolicy__s2ljjhjc0pq5arn21mjn8r0rqfjhmjm3gl6s4ceva98ttk9mher2s3tebpb73j0p/family1/c3f2fb241c10436c830481cf516d7a8e into 97b71e93d23ff8810dbd42b157c10dd3/family1 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/aee64428476a4635a56065d0cdbe34d3_SeqId_44_ - updating store file list. 2023-03-14 14:53:30,928 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/aee64428476a4635a56065d0cdbe34d3_SeqId_44_ into 97b71e93d23ff8810dbd42b157c10dd3/family1 2023-03-14 14:53:30,928 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionWithMonthlyPolicy__s2ljjhjc0pq5arn21mjn8r0rqfjhmjm3gl6s4ceva98ttk9mher2s3tebpb73j0p/family1/c3f2fb241c10436c830481cf516d7a8e into 97b71e93d23ff8810dbd42b157c10dd3/family1 (new location: hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/aee64428476a4635a56065d0cdbe34d3_SeqId_44_) 2023-03-14 14:53:30,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionWithMonthlyPolicy__s2ljjhjc0pq5arn21mjn8r0rqfjhmjm3gl6s4ceva98ttk9mher2s3tebpb73j0p/family1/c3f2fb241c10436c830481cf516d7a8e 2023-03-14 14:53:30,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-14 14:53:30,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-14 14:53:30,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(1912): 97b71e93d23ff8810dbd42b157c10dd3/family1 is initiating minor compaction 2023-03-14 14:53:30,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@5edfab2c; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-14 14:53:30,942 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 97b71e93d23ff8810dbd42b157c10dd3/family1 in testMajorCompactionWithMonthlyPolicy,,1678805599570.97b71e93d23ff8810dbd42b157c10dd3. 2023-03-14 14:53:30,942 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/9f2572585bb6411692a8b3548eb2a8db, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/19540c3734e04de69e67e5621c27463b, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/bd03d81c817549f585f9940e8422a03d, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/ec555014c14d4eeb85d13f0ad9443f18, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/d45b93a5590342a3a666803305e2f9ac, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/56d76262670941479eb8ea4a25faa84c, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/ec8503140042471a8fa90d8e7aec6815, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/f5bb9a22fbec41dda7699a8fc45c436e, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/ba050b9b269940f58ff3af92078e1532, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/aee64428476a4635a56065d0cdbe34d3_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/.tmp, totalSize=49.7 K 2023-03-14 14:53:30,942 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting 9f2572585bb6411692a8b3548eb2a8db, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-14 14:53:30,943 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting 19540c3734e04de69e67e5621c27463b, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-14 14:53:30,943 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting bd03d81c817549f585f9940e8422a03d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-14 14:53:30,943 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting ec555014c14d4eeb85d13f0ad9443f18, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-14 14:53:30,943 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting d45b93a5590342a3a666803305e2f9ac, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-14 14:53:30,943 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting 56d76262670941479eb8ea4a25faa84c, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-14 14:53:30,943 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting ec8503140042471a8fa90d8e7aec6815, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-14 14:53:30,943 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting f5bb9a22fbec41dda7699a8fc45c436e, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-14 14:53:30,943 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting ba050b9b269940f58ff3af92078e1532, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-14 14:53:30,943 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting aee64428476a4635a56065d0cdbe34d3_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-14 14:53:30,950 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-14 14:53:30,951 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 14:53:30,953 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101baa5f709274046e285e7b8c780dd6652 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101baa5f709274046e285e7b8c780dd6652 2023-03-14 14:53:30,955 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103fb8c862efde946318f07dced348e8ce7 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103fb8c862efde946318f07dced348e8ce7 2023-03-14 14:53:30,955 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-03-14 14:53:30,955 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-03-14 14:53:30,955 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-14 14:53:30,956 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-14 14:53:31,091 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] throttle.PressureAwareThroughputController(145): 97b71e93d23ff8810dbd42b157c10dd3#family1#compaction#22 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-14 14:53:31,128 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/.tmp/family1/b48df67fa6804e00bae089bd8c0c99ff as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/b48df67fa6804e00bae089bd8c0c99ff 2023-03-14 14:53:31,143 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 97b71e93d23ff8810dbd42b157c10dd3/family1 of 97b71e93d23ff8810dbd42b157c10dd3 into b48df67fa6804e00bae089bd8c0c99ff(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-14 14:53:31,143 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 97b71e93d23ff8810dbd42b157c10dd3: 2023-03-14 14:53:31,144 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1678805599570.97b71e93d23ff8810dbd42b157c10dd3., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1678805610942; duration=0sec 2023-03-14 14:53:31,144 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-14 14:53:31,227 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/9f2572585bb6411692a8b3548eb2a8db, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/19540c3734e04de69e67e5621c27463b, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/bd03d81c817549f585f9940e8422a03d, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/ec555014c14d4eeb85d13f0ad9443f18, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/d45b93a5590342a3a666803305e2f9ac, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/56d76262670941479eb8ea4a25faa84c, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/ec8503140042471a8fa90d8e7aec6815, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/f5bb9a22fbec41dda7699a8fc45c436e, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/ba050b9b269940f58ff3af92078e1532, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/aee64428476a4635a56065d0cdbe34d3_SeqId_44_] to archive 2023-03-14 14:53:31,228 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 14:53:31,230 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/9f2572585bb6411692a8b3548eb2a8db to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/9f2572585bb6411692a8b3548eb2a8db 2023-03-14 14:53:31,231 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/19540c3734e04de69e67e5621c27463b to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/19540c3734e04de69e67e5621c27463b 2023-03-14 14:53:31,233 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/bd03d81c817549f585f9940e8422a03d to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/bd03d81c817549f585f9940e8422a03d 2023-03-14 14:53:31,234 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/ec555014c14d4eeb85d13f0ad9443f18 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/ec555014c14d4eeb85d13f0ad9443f18 2023-03-14 14:53:31,236 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/d45b93a5590342a3a666803305e2f9ac to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/d45b93a5590342a3a666803305e2f9ac 2023-03-14 14:53:31,237 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/56d76262670941479eb8ea4a25faa84c to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/56d76262670941479eb8ea4a25faa84c 2023-03-14 14:53:31,239 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/ec8503140042471a8fa90d8e7aec6815 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/ec8503140042471a8fa90d8e7aec6815 2023-03-14 14:53:31,240 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/f5bb9a22fbec41dda7699a8fc45c436e to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/f5bb9a22fbec41dda7699a8fc45c436e 2023-03-14 14:53:31,242 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/ba050b9b269940f58ff3af92078e1532 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/ba050b9b269940f58ff3af92078e1532 2023-03-14 14:53:31,243 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/aee64428476a4635a56065d0cdbe34d3_SeqId_44_ to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/aee64428476a4635a56065d0cdbe34d3_SeqId_44_ 2023-03-14 14:53:31,894 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512318a3685c3461646149ae93134f6351dd7 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512318a3685c3461646149ae93134f6351dd7 2023-03-14 14:53:31,896 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-14 14:53:31,926 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/c83fc6f463e04aadb121c170e300bc13 first=Optional[r1] last=Optional[r4] 2023-03-14 14:53:31,927 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1678805599570.97b71e93d23ff8810dbd42b157c10dd3., hostname=jenkins-hbase20.apache.org,41317,1678805580877, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/c83fc6f463e04aadb121c170e300bc13}] 2023-03-14 14:53:31,929 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/c83fc6f463e04aadb121c170e300bc13 for inclusion in 97b71e93d23ff8810dbd42b157c10dd3/family1 2023-03-14 14:53:31,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-03-14 14:53:31,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(777): Region bounds: first= last= 2023-03-14 14:53:31,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HRegion(2446): Flush status journal for 97b71e93d23ff8810dbd42b157c10dd3: 2023-03-14 14:53:31,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/c83fc6f463e04aadb121c170e300bc13 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionWithMonthlyPolicy__s0te1ghnu9409sapcie0517hr45kl6m6bv7i9ghnf6ui5vfoid4mb9ahev5pb32p/family1/c83fc6f463e04aadb121c170e300bc13 2023-03-14 14:53:31,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionWithMonthlyPolicy__s0te1ghnu9409sapcie0517hr45kl6m6bv7i9ghnf6ui5vfoid4mb9ahev5pb32p/family1/c83fc6f463e04aadb121c170e300bc13 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/2d7bd8f6d4f64e249f836dfba2ad2e64_SeqId_47_ 2023-03-14 14:53:31,939 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionWithMonthlyPolicy__s0te1ghnu9409sapcie0517hr45kl6m6bv7i9ghnf6ui5vfoid4mb9ahev5pb32p/family1/c83fc6f463e04aadb121c170e300bc13 into 97b71e93d23ff8810dbd42b157c10dd3/family1 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/2d7bd8f6d4f64e249f836dfba2ad2e64_SeqId_47_ - updating store file list. 2023-03-14 14:53:31,944 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/2d7bd8f6d4f64e249f836dfba2ad2e64_SeqId_47_ into 97b71e93d23ff8810dbd42b157c10dd3/family1 2023-03-14 14:53:31,945 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionWithMonthlyPolicy__s0te1ghnu9409sapcie0517hr45kl6m6bv7i9ghnf6ui5vfoid4mb9ahev5pb32p/family1/c83fc6f463e04aadb121c170e300bc13 into 97b71e93d23ff8810dbd42b157c10dd3/family1 (new location: hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/2d7bd8f6d4f64e249f836dfba2ad2e64_SeqId_47_) 2023-03-14 14:53:31,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionWithMonthlyPolicy__s0te1ghnu9409sapcie0517hr45kl6m6bv7i9ghnf6ui5vfoid4mb9ahev5pb32p/family1/c83fc6f463e04aadb121c170e300bc13 2023-03-14 14:53:31,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-14 14:53:31,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-14 14:53:31,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(1912): 97b71e93d23ff8810dbd42b157c10dd3/family1 is initiating minor compaction (all files) 2023-03-14 14:53:31,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@54a49b5d; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-14 14:53:31,947 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 97b71e93d23ff8810dbd42b157c10dd3/family1 in testMajorCompactionWithMonthlyPolicy,,1678805599570.97b71e93d23ff8810dbd42b157c10dd3. 2023-03-14 14:53:31,947 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/8b5c2f1719d4444489e8c27aa0329450, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/b48df67fa6804e00bae089bd8c0c99ff, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/2d7bd8f6d4f64e249f836dfba2ad2e64_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/.tmp, totalSize=178.1 K 2023-03-14 14:53:31,948 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting 8b5c2f1719d4444489e8c27aa0329450, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878806007 2023-03-14 14:53:31,948 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting b48df67fa6804e00bae089bd8c0c99ff, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621206007 2023-03-14 14:53:31,949 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-14 14:53:31,949 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting 2d7bd8f6d4f64e249f836dfba2ad2e64_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965206007 2023-03-14 14:53:31,949 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 14:53:31,951 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201371baeb8672b4918904592c1710c6485 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201371baeb8672b4918904592c1710c6485 2023-03-14 14:53:31,953 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205d8dafebe96854f918cdad07f327c2d1a to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205d8dafebe96854f918cdad07f327c2d1a 2023-03-14 14:53:31,954 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015122862f41e28075d422a88ad587ded41d883 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015122862f41e28075d422a88ad587ded41d883 2023-03-14 14:53:31,955 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512319fb1ca92d94248788f18b1dc0a3e7daf to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512319fb1ca92d94248788f18b1dc0a3e7daf 2023-03-14 14:53:31,956 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-03-14 14:53:31,956 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-03-14 14:53:31,956 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-14 14:53:31,956 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-14 14:53:31,975 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] throttle.PressureAwareThroughputController(145): 97b71e93d23ff8810dbd42b157c10dd3#family1#compaction#23 average throughput is 11.97 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-14 14:53:32,416 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/.tmp/family1/5d74b3fd98ac4225a3d893df01b73e58 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/5d74b3fd98ac4225a3d893df01b73e58 2023-03-14 14:53:32,425 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 97b71e93d23ff8810dbd42b157c10dd3/family1 of 97b71e93d23ff8810dbd42b157c10dd3 into 5d74b3fd98ac4225a3d893df01b73e58(size=167.4 K), total size for store is 167.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-14 14:53:32,425 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 97b71e93d23ff8810dbd42b157c10dd3: 2023-03-14 14:53:32,426 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1678805599570.97b71e93d23ff8810dbd42b157c10dd3., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1678805611947; duration=0sec 2023-03-14 14:53:32,426 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-14 14:53:32,520 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/8b5c2f1719d4444489e8c27aa0329450, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/b48df67fa6804e00bae089bd8c0c99ff, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/2d7bd8f6d4f64e249f836dfba2ad2e64_SeqId_47_] to archive 2023-03-14 14:53:32,521 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 14:53:32,526 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/8b5c2f1719d4444489e8c27aa0329450 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/8b5c2f1719d4444489e8c27aa0329450 2023-03-14 14:53:32,529 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/b48df67fa6804e00bae089bd8c0c99ff to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/b48df67fa6804e00bae089bd8c0c99ff 2023-03-14 14:53:32,532 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/2d7bd8f6d4f64e249f836dfba2ad2e64_SeqId_47_ to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/2d7bd8f6d4f64e249f836dfba2ad2e64_SeqId_47_ 2023-03-14 14:53:32,824 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130826028f544b14fb4974ee52b7675568a to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130826028f544b14fb4974ee52b7675568a 2023-03-14 14:53:32,825 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-14 14:53:32,849 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/fa2b89e025b14f9b952c51c3ba470924 first=Optional[r00] last=Optional[r8] 2023-03-14 14:53:32,850 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1678805599570.97b71e93d23ff8810dbd42b157c10dd3., hostname=jenkins-hbase20.apache.org,41317,1678805580877, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/fa2b89e025b14f9b952c51c3ba470924}] 2023-03-14 14:53:32,852 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/fa2b89e025b14f9b952c51c3ba470924 for inclusion in 97b71e93d23ff8810dbd42b157c10dd3/family1 2023-03-14 14:53:32,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-03-14 14:53:32,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(777): Region bounds: first= last= 2023-03-14 14:53:32,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HRegion(2446): Flush status journal for 97b71e93d23ff8810dbd42b157c10dd3: 2023-03-14 14:53:32,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/fa2b89e025b14f9b952c51c3ba470924 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionWithMonthlyPolicy__joi7nnie7qmrsftv8m1bm5naritve1nlpk9645jvm847rda8medqcv3jhrauuobc/family1/fa2b89e025b14f9b952c51c3ba470924 2023-03-14 14:53:32,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionWithMonthlyPolicy__joi7nnie7qmrsftv8m1bm5naritve1nlpk9645jvm847rda8medqcv3jhrauuobc/family1/fa2b89e025b14f9b952c51c3ba470924 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/921bf43309154334b0c5d0e57a4d0fb6_SeqId_50_ 2023-03-14 14:53:32,861 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionWithMonthlyPolicy__joi7nnie7qmrsftv8m1bm5naritve1nlpk9645jvm847rda8medqcv3jhrauuobc/family1/fa2b89e025b14f9b952c51c3ba470924 into 97b71e93d23ff8810dbd42b157c10dd3/family1 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/921bf43309154334b0c5d0e57a4d0fb6_SeqId_50_ - updating store file list. 2023-03-14 14:53:32,866 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/921bf43309154334b0c5d0e57a4d0fb6_SeqId_50_ into 97b71e93d23ff8810dbd42b157c10dd3/family1 2023-03-14 14:53:32,866 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionWithMonthlyPolicy__joi7nnie7qmrsftv8m1bm5naritve1nlpk9645jvm847rda8medqcv3jhrauuobc/family1/fa2b89e025b14f9b952c51c3ba470924 into 97b71e93d23ff8810dbd42b157c10dd3/family1 (new location: hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/family1/921bf43309154334b0c5d0e57a4d0fb6_SeqId_50_) 2023-03-14 14:53:32,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionWithMonthlyPolicy__joi7nnie7qmrsftv8m1bm5naritve1nlpk9645jvm847rda8medqcv3jhrauuobc/family1/fa2b89e025b14f9b952c51c3ba470924 2023-03-14 14:53:32,869 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-14 14:53:32,870 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 14:53:32,872 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015112094cc48d9d68b47a28782393f61745f23 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015112094cc48d9d68b47a28782393f61745f23 2023-03-14 14:53:32,873 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151128bc0da0bcfe464707b6924dafe6d6d775 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151128bc0da0bcfe464707b6924dafe6d6d775 2023-03-14 14:53:32,874 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130b2a3a52963994110b8e3812146430c66 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130b2a3a52963994110b8e3812146430c66 2023-03-14 14:53:32,874 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-03-14 14:53:32,874 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-03-14 14:53:32,875 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-14 14:53:32,875 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-14 14:53:32,875 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-03-14 14:53:32,875 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-03-14 14:53:32,875 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-14 14:53:32,876 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=22, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-03-14 14:53:32,878 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=22, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 2.8860 sec 2023-03-14 14:53:32,994 INFO [Listener at localhost.localdomain/44261] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=255 (was 248) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50211@0x22c523d1-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: hconnection-0x656bfced-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/32713c79-3a0d-e28f-4850-1b932c385dc5/cluster_ea1a76c9-5fcc-f1b0-725a-f88680cff8ea/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50211@0x22c523d1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/105092891.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1767526330_15 at /127.0.0.1:43678 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x656bfced-shared-pool-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1767526330_15 at /127.0.0.1:43692 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/32713c79-3a0d-e28f-4850-1b932c385dc5/cluster_ea1a76c9-5fcc-f1b0-725a-f88680cff8ea/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x656bfced-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1767526330_15 at /127.0.0.1:37120 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1767526330_15 at /127.0.0.1:43826 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1767526330_15 at /127.0.0.1:43746 [Waiting for operation #15] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1767526330_15 at /127.0.0.1:43762 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x656bfced-shared-pool-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x656bfced-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1767526330_15 at /127.0.0.1:43658 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-800586564_15 at /127.0.0.1:37152 [Waiting for operation #18] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1767526330_15 at /127.0.0.1:43704 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x656bfced-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:50211@0x22c523d1-SendThread(127.0.0.1:50211) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1767526330_15 at /127.0.0.1:37136 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1767526330_15 at /127.0.0.1:43668 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1767526330_15 at /127.0.0.1:43714 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1767526330_15 at /127.0.0.1:43836 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x656bfced-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1767526330_15 at /127.0.0.1:43774 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1767526330_15 at /127.0.0.1:37088 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-800586564_15 at /127.0.0.1:37140 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=604 (was 593) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=332 (was 373), ProcessCount=169 (was 167) - ProcessCount LEAK? -, AvailableMemoryMB=12636 (was 12741) 2023-03-14 14:53:33,004 INFO [Listener at localhost.localdomain/44261] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=255, OpenFileDescriptor=604, MaxFileDescriptor=60000, SystemLoadAverage=332, ProcessCount=169, AvailableMemoryMB=12634 2023-03-14 14:53:33,006 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-03-14 14:53:33,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure2.ProcedureExecutor(1029): Stored pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:33,009 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-03-14 14:53:33,009 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithWeeklyPolicy" procId is: 23 2023-03-14 14:53:33,010 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-14 14:53:33,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-03-14 14:53:33,011 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1 2023-03-14 14:53:33,012 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1 empty. 2023-03-14 14:53:33,012 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1 2023-03-14 14:53:33,012 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithWeeklyPolicy regions 2023-03-14 14:53:33,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-03-14 14:53:33,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-03-14 14:53:33,423 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-03-14 14:53:33,425 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 984e5359c7c1d404d5a6dab33d5d90f1, NAME => 'testMinorCompactionWithWeeklyPolicy,,1678805613006.984e5359c7c1d404d5a6dab33d5d90f1.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp 2023-03-14 14:53:33,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-03-14 14:53:33,835 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1678805613006.984e5359c7c1d404d5a6dab33d5d90f1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 14:53:33,835 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing 984e5359c7c1d404d5a6dab33d5d90f1, disabling compactions & flushes 2023-03-14 14:53:33,835 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1678805613006.984e5359c7c1d404d5a6dab33d5d90f1. 2023-03-14 14:53:33,835 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1678805613006.984e5359c7c1d404d5a6dab33d5d90f1. 2023-03-14 14:53:33,835 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1678805613006.984e5359c7c1d404d5a6dab33d5d90f1. after waiting 0 ms 2023-03-14 14:53:33,836 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1678805613006.984e5359c7c1d404d5a6dab33d5d90f1. 2023-03-14 14:53:33,836 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1678805613006.984e5359c7c1d404d5a6dab33d5d90f1. 2023-03-14 14:53:33,836 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 984e5359c7c1d404d5a6dab33d5d90f1: 2023-03-14 14:53:33,838 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-03-14 14:53:33,840 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithWeeklyPolicy,,1678805613006.984e5359c7c1d404d5a6dab33d5d90f1.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1678805613840"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678805613840"}]},"ts":"1678805613840"} 2023-03-14 14:53:33,841 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-14 14:53:33,842 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-14 14:53:33,843 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678805613843"}]},"ts":"1678805613843"} 2023-03-14 14:53:33,844 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-03-14 14:53:33,847 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=984e5359c7c1d404d5a6dab33d5d90f1, ASSIGN}] 2023-03-14 14:53:33,849 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=984e5359c7c1d404d5a6dab33d5d90f1, ASSIGN 2023-03-14 14:53:33,850 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=984e5359c7c1d404d5a6dab33d5d90f1, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,41317,1678805580877; forceNewPlan=false, retain=false 2023-03-14 14:53:34,002 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=984e5359c7c1d404d5a6dab33d5d90f1, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:34,003 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithWeeklyPolicy,,1678805613006.984e5359c7c1d404d5a6dab33d5d90f1.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1678805614002"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1678805614002"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678805614002"}]},"ts":"1678805614002"} 2023-03-14 14:53:34,007 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=24, state=RUNNABLE; OpenRegionProcedure 984e5359c7c1d404d5a6dab33d5d90f1, server=jenkins-hbase20.apache.org,41317,1678805580877}] 2023-03-14 14:53:34,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-03-14 14:53:34,167 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMinorCompactionWithWeeklyPolicy,,1678805613006.984e5359c7c1d404d5a6dab33d5d90f1. 2023-03-14 14:53:34,168 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 984e5359c7c1d404d5a6dab33d5d90f1, NAME => 'testMinorCompactionWithWeeklyPolicy,,1678805613006.984e5359c7c1d404d5a6dab33d5d90f1.', STARTKEY => '', ENDKEY => ''} 2023-03-14 14:53:34,169 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithWeeklyPolicy 984e5359c7c1d404d5a6dab33d5d90f1 2023-03-14 14:53:34,169 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1678805613006.984e5359c7c1d404d5a6dab33d5d90f1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 14:53:34,169 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 984e5359c7c1d404d5a6dab33d5d90f1 2023-03-14 14:53:34,169 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 984e5359c7c1d404d5a6dab33d5d90f1 2023-03-14 14:53:34,173 INFO [StoreOpener-984e5359c7c1d404d5a6dab33d5d90f1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 984e5359c7c1d404d5a6dab33d5d90f1 2023-03-14 14:53:34,176 DEBUG [StoreOpener-984e5359c7c1d404d5a6dab33d5d90f1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1 2023-03-14 14:53:34,176 DEBUG [StoreOpener-984e5359c7c1d404d5a6dab33d5d90f1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1 2023-03-14 14:53:34,177 INFO [StoreOpener-984e5359c7c1d404d5a6dab33d5d90f1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 984e5359c7c1d404d5a6dab33d5d90f1 columnFamilyName family1 2023-03-14 14:53:34,180 INFO [StoreOpener-984e5359c7c1d404d5a6dab33d5d90f1-1] regionserver.HStore(310): Store=984e5359c7c1d404d5a6dab33d5d90f1/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 14:53:34,181 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1 2023-03-14 14:53:34,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1 2023-03-14 14:53:34,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 984e5359c7c1d404d5a6dab33d5d90f1 2023-03-14 14:53:34,190 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-14 14:53:34,191 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 984e5359c7c1d404d5a6dab33d5d90f1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68799135, jitterRate=0.025187000632286072}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-14 14:53:34,191 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 984e5359c7c1d404d5a6dab33d5d90f1: 2023-03-14 14:53:34,192 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMinorCompactionWithWeeklyPolicy,,1678805613006.984e5359c7c1d404d5a6dab33d5d90f1., pid=25, masterSystemTime=1678805614160 2023-03-14 14:53:34,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMinorCompactionWithWeeklyPolicy,,1678805613006.984e5359c7c1d404d5a6dab33d5d90f1. 2023-03-14 14:53:34,195 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMinorCompactionWithWeeklyPolicy,,1678805613006.984e5359c7c1d404d5a6dab33d5d90f1. 2023-03-14 14:53:34,196 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=984e5359c7c1d404d5a6dab33d5d90f1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:34,196 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithWeeklyPolicy,,1678805613006.984e5359c7c1d404d5a6dab33d5d90f1.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1678805614196"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1678805614196"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678805614196"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678805614196"}]},"ts":"1678805614196"} 2023-03-14 14:53:34,201 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=24 2023-03-14 14:53:34,201 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=24, state=SUCCESS; OpenRegionProcedure 984e5359c7c1d404d5a6dab33d5d90f1, server=jenkins-hbase20.apache.org,41317,1678805580877 in 191 msec 2023-03-14 14:53:34,203 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-03-14 14:53:34,203 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=984e5359c7c1d404d5a6dab33d5d90f1, ASSIGN in 354 msec 2023-03-14 14:53:34,203 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-14 14:53:34,203 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678805614203"}]},"ts":"1678805614203"} 2023-03-14 14:53:34,205 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-03-14 14:53:34,260 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-03-14 14:53:34,263 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=23, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy in 1.2540 sec 2023-03-14 14:53:35,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-03-14 14:53:35,122 INFO [Listener at localhost.localdomain/44261] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithWeeklyPolicy, procId: 23 completed 2023-03-14 14:53:35,160 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:53:35,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:35,162 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-14 14:53:35,162 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:53:35,162 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-14 14:53:35,162 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-14 14:53:35,163 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:35,163 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:35,163 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:53:35,163 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:35,164 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:53:35,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:53:35,164 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:35,164 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:53:35,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:35,164 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:35,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:53:35,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:35,165 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:35,165 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:35,165 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-14 14:53:35,165 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:53:35,165 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-14 14:53:35,165 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 14:53:35,165 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:53:35,165 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1678805613006.984e5359c7c1d404d5a6dab33d5d90f1. 2023-03-14 14:53:35,165 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1678805613006.984e5359c7c1d404d5a6dab33d5d90f1. started... 2023-03-14 14:53:35,166 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 984e5359c7c1d404d5a6dab33d5d90f1 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-14 14:53:35,599 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130f923f0908f274bac9e705053a14e0861 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151130f923f0908f274bac9e705053a14e0861 2023-03-14 14:53:36,005 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/.tmp/family1/6af66b28e98849239ba551917d2648e8 2023-03-14 14:53:36,022 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/.tmp/family1/6af66b28e98849239ba551917d2648e8 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/6af66b28e98849239ba551917d2648e8 2023-03-14 14:53:36,028 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/6af66b28e98849239ba551917d2648e8, entries=1000, sequenceid=5, filesize=165.1 K 2023-03-14 14:53:36,029 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 984e5359c7c1d404d5a6dab33d5d90f1 in 863ms, sequenceid=5, compaction requested=false 2023-03-14 14:53:36,029 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithWeeklyPolicy' 2023-03-14 14:53:36,030 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 984e5359c7c1d404d5a6dab33d5d90f1: 2023-03-14 14:53:36,030 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1678805613006.984e5359c7c1d404d5a6dab33d5d90f1. 2023-03-14 14:53:36,030 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 14:53:36,030 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 14:53:36,030 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:36,030 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-14 14:53:36,030 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-14 14:53:36,032 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:36,032 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:36,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:36,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:36,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:36,032 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:36,032 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:53:36,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:36,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:36,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:36,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:36,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:36,034 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-14 14:53:36,034 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5d12bac8[Count = 0] remaining members to acquire global barrier 2023-03-14 14:53:36,034 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-14 14:53:36,034 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:36,035 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:36,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:36,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:36,035 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-14 14:53:36,035 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-14 14:53:36,035 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:53:36,035 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:36,035 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:53:36,036 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:36,036 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-14 14:53:36,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:36,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:36,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:36,036 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:53:36,036 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-14 14:53:36,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:36,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:36,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:36,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:36,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:36,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:36,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:36,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:53:36,040 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-14 14:53:36,040 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-14 14:53:36,040 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:53:36,040 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:53:36,040 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:36,040 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:53:36,042 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:36,042 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:36,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:36,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:36,042 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:53:36,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:36,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:36,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:36,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:53:36,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:53:36,042 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:36,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:36,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:36,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:36,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:36,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:36,044 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:36,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:36,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:36,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:36,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:36,047 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:36,047 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:36,047 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:36,047 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:53:36,047 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:53:36,047 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-14 14:53:36,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:53:36,047 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:53:36,047 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-14 14:53:36,047 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:53:36,047 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:36,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:53:36,047 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:36,048 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:36,048 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:36,048 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-14 14:53:36,048 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:53:36,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:53:36,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:53:36,148 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:53:36,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:53:36,161 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:53:36,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-14 14:53:36,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:36,163 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-14 14:53:36,163 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:53:36,163 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-14 14:53:36,163 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-14 14:53:36,164 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:36,164 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:36,165 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:53:36,165 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:36,165 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:53:36,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:53:36,165 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:36,165 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:53:36,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:36,166 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:36,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:53:36,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:36,167 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:36,167 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-14 14:53:36,167 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:36,167 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-14 14:53:36,167 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:53:36,167 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-14 14:53:36,167 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 14:53:36,167 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:53:36,167 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1678805613006.984e5359c7c1d404d5a6dab33d5d90f1. 2023-03-14 14:53:36,167 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1678805613006.984e5359c7c1d404d5a6dab33d5d90f1. started... 2023-03-14 14:53:36,167 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 984e5359c7c1d404d5a6dab33d5d90f1 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-14 14:53:36,588 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128152b7a9f77d2468f8a8060d57928f970 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151128152b7a9f77d2468f8a8060d57928f970 2023-03-14 14:53:36,997 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/.tmp/family1/8160888bf3ee4ca986aac3cea18515d5 2023-03-14 14:53:37,008 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/.tmp/family1/8160888bf3ee4ca986aac3cea18515d5 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/8160888bf3ee4ca986aac3cea18515d5 2023-03-14 14:53:37,016 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/8160888bf3ee4ca986aac3cea18515d5, entries=1, sequenceid=9, filesize=5.0 K 2023-03-14 14:53:37,017 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 984e5359c7c1d404d5a6dab33d5d90f1 in 850ms, sequenceid=9, compaction requested=false 2023-03-14 14:53:37,018 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 984e5359c7c1d404d5a6dab33d5d90f1: 2023-03-14 14:53:37,018 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1678805613006.984e5359c7c1d404d5a6dab33d5d90f1. 2023-03-14 14:53:37,018 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 14:53:37,018 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 14:53:37,018 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:37,018 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-14 14:53:37,018 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-14 14:53:37,020 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:37,020 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:37,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:37,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:37,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:37,020 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:37,020 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:53:37,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:37,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:37,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:37,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:37,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:37,022 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-14 14:53:37,022 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d9151e4[Count = 0] remaining members to acquire global barrier 2023-03-14 14:53:37,022 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-14 14:53:37,022 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:37,023 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:37,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:37,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:37,024 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-14 14:53:37,024 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-14 14:53:37,024 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:37,024 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:53:37,024 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:53:37,025 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:37,025 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-14 14:53:37,025 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:53:37,025 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-14 14:53:37,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:37,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:37,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:37,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:37,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:37,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:37,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:37,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:37,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:37,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:37,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:53:37,028 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-14 14:53:37,028 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-14 14:53:37,029 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:53:37,029 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:53:37,029 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:37,029 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:53:37,039 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:37,039 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:37,039 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:37,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:37,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:37,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:37,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:37,039 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:53:37,039 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:53:37,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:53:37,040 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:37,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:37,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:37,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:37,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:37,042 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:37,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:37,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:37,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:37,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:37,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:37,047 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:37,047 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:37,047 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:53:37,047 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:53:37,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:53:37,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:53:37,047 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:53:37,047 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-14 14:53:37,048 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:53:37,047 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:37,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:53:37,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:53:37,048 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:37,048 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:37,048 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-14 14:53:37,048 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:37,048 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-14 14:53:37,048 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:37,048 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:53:37,149 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:53:37,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:53:37,159 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:53:37,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-14 14:53:37,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:37,163 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-14 14:53:37,163 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:53:37,163 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-14 14:53:37,163 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-14 14:53:37,164 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:37,165 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:37,166 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:53:37,166 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:37,166 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:53:37,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:53:37,167 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:37,167 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:53:37,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:37,168 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:37,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:53:37,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:37,169 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:37,169 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-14 14:53:37,169 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:37,170 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-14 14:53:37,170 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:53:37,170 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-14 14:53:37,170 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 14:53:37,170 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:53:37,170 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1678805613006.984e5359c7c1d404d5a6dab33d5d90f1. 2023-03-14 14:53:37,170 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1678805613006.984e5359c7c1d404d5a6dab33d5d90f1. started... 2023-03-14 14:53:37,171 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 984e5359c7c1d404d5a6dab33d5d90f1 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 14:53:37,599 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512010ef8fc832787410f866b69e032506727 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512010ef8fc832787410f866b69e032506727 2023-03-14 14:53:38,008 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/.tmp/family1/5dc3177c6518407b8585f68dcdcdb216 2023-03-14 14:53:38,021 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/.tmp/family1/5dc3177c6518407b8585f68dcdcdb216 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/5dc3177c6518407b8585f68dcdcdb216 2023-03-14 14:53:38,026 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/5dc3177c6518407b8585f68dcdcdb216, entries=1, sequenceid=13, filesize=4.9 K 2023-03-14 14:53:38,027 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 984e5359c7c1d404d5a6dab33d5d90f1 in 856ms, sequenceid=13, compaction requested=true 2023-03-14 14:53:38,027 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 984e5359c7c1d404d5a6dab33d5d90f1: 2023-03-14 14:53:38,027 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1678805613006.984e5359c7c1d404d5a6dab33d5d90f1. 2023-03-14 14:53:38,027 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 14:53:38,027 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 14:53:38,027 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:38,028 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-14 14:53:38,028 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-14 14:53:38,029 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:38,029 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:38,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:38,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:38,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:38,029 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:38,029 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:53:38,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:38,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:38,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:38,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:38,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:38,031 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-14 14:53:38,031 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1a294cbc[Count = 0] remaining members to acquire global barrier 2023-03-14 14:53:38,031 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-14 14:53:38,031 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:38,031 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:38,031 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:38,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:38,032 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-14 14:53:38,032 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-14 14:53:38,032 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:53:38,032 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:38,032 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:53:38,032 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:38,033 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-14 14:53:38,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:38,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:38,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:38,033 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:53:38,033 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-14 14:53:38,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:38,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:38,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:38,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:38,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:38,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:38,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:38,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:53:38,035 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-14 14:53:38,035 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-14 14:53:38,035 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:53:38,035 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:53:38,035 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:38,035 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:53:38,036 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:38,036 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:38,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:38,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:38,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:38,036 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:53:38,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:38,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:38,037 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:38,037 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:53:38,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:53:38,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:38,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:38,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:38,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:38,038 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:38,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:38,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:38,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:38,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:38,041 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:38,041 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:38,041 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:53:38,041 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:38,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:53:38,041 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:53:38,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:53:38,041 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-14 14:53:38,041 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:53:38,041 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:38,041 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-14 14:53:38,041 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:53:38,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:53:38,042 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-14 14:53:38,041 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:38,042 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:53:38,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:53:38,042 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:38,042 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:38,142 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:53:38,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:53:38,154 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:53:38,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-14 14:53:38,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:38,156 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-14 14:53:38,156 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:53:38,156 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-14 14:53:38,156 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-14 14:53:38,157 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:38,157 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:38,158 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:38,158 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:53:38,158 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:53:38,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:53:38,158 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:38,158 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:53:38,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:38,159 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:38,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:53:38,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:38,159 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:38,159 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-14 14:53:38,160 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:38,160 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-14 14:53:38,160 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:53:38,160 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-14 14:53:38,160 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 14:53:38,160 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:53:38,160 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1678805613006.984e5359c7c1d404d5a6dab33d5d90f1. 2023-03-14 14:53:38,160 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1678805613006.984e5359c7c1d404d5a6dab33d5d90f1. started... 2023-03-14 14:53:38,160 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 984e5359c7c1d404d5a6dab33d5d90f1 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 14:53:38,604 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-14 14:53:38,604 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205abd26d3804544db9865927ac2bdd1bd2 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205abd26d3804544db9865927ac2bdd1bd2 2023-03-14 14:53:38,604 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0dc02ef1 to 127.0.0.1:50211 2023-03-14 14:53:38,604 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-14 14:53:38,605 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-14 14:53:38,606 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4826e5a2 to 127.0.0.1:50211 2023-03-14 14:53:38,606 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-14 14:53:38,606 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-14 14:53:38,606 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x22c523d1 to 127.0.0.1:50211 2023-03-14 14:53:38,606 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-14 14:53:39,012 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/.tmp/family1/0c3bba70c773484e89f9d0b67370f07f 2023-03-14 14:53:39,025 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/.tmp/family1/0c3bba70c773484e89f9d0b67370f07f as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/0c3bba70c773484e89f9d0b67370f07f 2023-03-14 14:53:39,031 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/0c3bba70c773484e89f9d0b67370f07f, entries=1, sequenceid=17, filesize=4.9 K 2023-03-14 14:53:39,031 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 984e5359c7c1d404d5a6dab33d5d90f1 in 871ms, sequenceid=17, compaction requested=true 2023-03-14 14:53:39,032 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 984e5359c7c1d404d5a6dab33d5d90f1: 2023-03-14 14:53:39,032 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1678805613006.984e5359c7c1d404d5a6dab33d5d90f1. 2023-03-14 14:53:39,032 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 14:53:39,032 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 14:53:39,032 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:39,032 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-14 14:53:39,032 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-14 14:53:39,033 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:39,033 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:39,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:39,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:39,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:39,034 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:39,034 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:53:39,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:39,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:39,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:39,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:39,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:39,035 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-14 14:53:39,035 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@62e071f9[Count = 0] remaining members to acquire global barrier 2023-03-14 14:53:39,035 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-14 14:53:39,035 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:39,036 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:39,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:39,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:39,036 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-14 14:53:39,036 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:39,036 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:53:39,036 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-14 14:53:39,036 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:53:39,037 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-14 14:53:39,037 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:39,037 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:53:39,037 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-14 14:53:39,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:39,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:39,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:39,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:39,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:39,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:39,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:39,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:39,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:39,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:39,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:53:39,040 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-14 14:53:39,040 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-14 14:53:39,040 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:53:39,040 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:53:39,040 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:39,040 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:53:39,041 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:39,041 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:39,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:39,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:39,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:39,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:39,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:39,041 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:53:39,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:39,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:53:39,042 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:39,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:53:39,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:39,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:39,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:39,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:39,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:39,043 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:39,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:39,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:39,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:39,045 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:39,045 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:53:39,045 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:39,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:53:39,045 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:53:39,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:53:39,045 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-14 14:53:39,045 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:53:39,045 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:53:39,045 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:39,045 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:39,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:53:39,045 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-14 14:53:39,045 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:53:39,045 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:39,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:53:39,046 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:39,046 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:39,146 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:53:39,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:53:39,157 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:53:39,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-14 14:53:39,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:39,161 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-14 14:53:39,161 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:53:39,161 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-14 14:53:39,161 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-14 14:53:39,162 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:39,162 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:39,163 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:39,163 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:53:39,163 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:53:39,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:53:39,164 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:39,164 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:53:39,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:39,164 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:39,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:53:39,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:39,165 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:39,165 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-14 14:53:39,165 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:39,165 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-14 14:53:39,165 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:53:39,165 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-14 14:53:39,165 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 14:53:39,165 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:53:39,165 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1678805613006.984e5359c7c1d404d5a6dab33d5d90f1. 2023-03-14 14:53:39,166 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1678805613006.984e5359c7c1d404d5a6dab33d5d90f1. started... 2023-03-14 14:53:39,166 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 984e5359c7c1d404d5a6dab33d5d90f1 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 14:53:39,588 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228c6382b7680d7471dad4c041f4d9a92a5 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228c6382b7680d7471dad4c041f4d9a92a5 2023-03-14 14:53:39,695 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-14 14:53:39,996 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/.tmp/family1/6b6c2eda5ef5473ab5a3c1072f596fa8 2023-03-14 14:53:40,009 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/.tmp/family1/6b6c2eda5ef5473ab5a3c1072f596fa8 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/6b6c2eda5ef5473ab5a3c1072f596fa8 2023-03-14 14:53:40,016 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/6b6c2eda5ef5473ab5a3c1072f596fa8, entries=1, sequenceid=21, filesize=4.9 K 2023-03-14 14:53:40,017 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 984e5359c7c1d404d5a6dab33d5d90f1 in 851ms, sequenceid=21, compaction requested=true 2023-03-14 14:53:40,017 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 984e5359c7c1d404d5a6dab33d5d90f1: 2023-03-14 14:53:40,017 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1678805613006.984e5359c7c1d404d5a6dab33d5d90f1. 2023-03-14 14:53:40,017 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 14:53:40,017 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 14:53:40,017 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:40,017 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-14 14:53:40,017 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-14 14:53:40,019 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:40,019 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:40,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:40,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:40,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:40,019 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:40,019 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:53:40,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:40,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:40,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:40,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:40,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:40,022 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-14 14:53:40,022 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2aec4397[Count = 0] remaining members to acquire global barrier 2023-03-14 14:53:40,022 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-14 14:53:40,022 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:40,022 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:40,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:40,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:40,023 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-14 14:53:40,023 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-14 14:53:40,023 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:53:40,023 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:40,023 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:53:40,024 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-14 14:53:40,024 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:40,024 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:53:40,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:40,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:40,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:40,024 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-14 14:53:40,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:40,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:40,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:40,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:40,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:40,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:40,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:40,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:53:40,027 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-14 14:53:40,027 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-14 14:53:40,028 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:53:40,028 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:53:40,028 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:40,028 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:53:40,029 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:40,029 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:40,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:40,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:40,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:40,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:40,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:40,030 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:53:40,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:40,030 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:40,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:53:40,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:53:40,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:40,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:40,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:40,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:40,032 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:40,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:40,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:40,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:40,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:40,035 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:40,035 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:40,035 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:53:40,035 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:40,035 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:53:40,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:53:40,035 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:53:40,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:53:40,035 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-14 14:53:40,035 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-14 14:53:40,036 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:53:40,035 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:40,036 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:40,036 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:40,036 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:40,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:53:40,036 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-14 14:53:40,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:53:40,037 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:53:40,137 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:53:40,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:53:40,151 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:53:40,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-14 14:53:40,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:40,155 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-14 14:53:40,155 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:53:40,155 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-14 14:53:40,155 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-14 14:53:40,156 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:40,156 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:40,158 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:53:40,158 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:40,158 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:53:40,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:53:40,159 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:40,159 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:53:40,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:40,160 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:40,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:53:40,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:40,161 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:40,161 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-14 14:53:40,162 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:40,162 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-14 14:53:40,162 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:53:40,162 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-14 14:53:40,162 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 14:53:40,162 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:53:40,162 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1678805613006.984e5359c7c1d404d5a6dab33d5d90f1. 2023-03-14 14:53:40,163 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1678805613006.984e5359c7c1d404d5a6dab33d5d90f1. started... 2023-03-14 14:53:40,163 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 984e5359c7c1d404d5a6dab33d5d90f1 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 14:53:40,586 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123147e4da906aa64446bf9523da9c8f6ae9 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015123147e4da906aa64446bf9523da9c8f6ae9 2023-03-14 14:53:40,996 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/.tmp/family1/b6b97acc2ce440c3bbc38cc84f89a850 2023-03-14 14:53:41,010 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/.tmp/family1/b6b97acc2ce440c3bbc38cc84f89a850 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/b6b97acc2ce440c3bbc38cc84f89a850 2023-03-14 14:53:41,017 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/b6b97acc2ce440c3bbc38cc84f89a850, entries=1, sequenceid=25, filesize=4.9 K 2023-03-14 14:53:41,018 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 984e5359c7c1d404d5a6dab33d5d90f1 in 855ms, sequenceid=25, compaction requested=true 2023-03-14 14:53:41,018 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 984e5359c7c1d404d5a6dab33d5d90f1: 2023-03-14 14:53:41,018 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1678805613006.984e5359c7c1d404d5a6dab33d5d90f1. 2023-03-14 14:53:41,018 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 14:53:41,018 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 14:53:41,018 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:41,018 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-14 14:53:41,018 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-14 14:53:41,019 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:41,019 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:41,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:41,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:41,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:41,020 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:41,020 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:53:41,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:41,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:41,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:41,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:41,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:41,021 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-14 14:53:41,021 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4d15395f[Count = 0] remaining members to acquire global barrier 2023-03-14 14:53:41,021 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-14 14:53:41,021 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:41,021 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:41,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:41,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:41,022 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-14 14:53:41,022 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-14 14:53:41,022 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:53:41,022 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:41,022 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:53:41,023 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:41,023 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-14 14:53:41,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:41,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:41,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:41,023 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:53:41,023 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-14 14:53:41,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:41,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:41,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:41,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:41,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:41,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:41,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:41,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:53:41,025 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-14 14:53:41,025 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-14 14:53:41,025 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:53:41,025 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:53:41,025 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:41,025 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:53:41,026 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:41,026 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:41,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:41,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:41,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:41,026 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:41,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:41,026 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:53:41,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:41,026 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:53:41,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:53:41,027 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:41,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:41,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:41,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:41,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:41,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:41,028 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:41,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:41,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:41,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:41,029 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:41,029 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:41,029 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:41,030 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:53:41,030 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-14 14:53:41,030 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:53:41,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:53:41,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:53:41,030 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:53:41,030 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:53:41,030 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:41,030 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-14 14:53:41,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:53:41,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:53:41,030 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:41,030 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:53:41,030 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:41,030 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:41,130 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:53:41,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:53:41,141 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:53:41,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-14 14:53:41,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:41,144 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-14 14:53:41,144 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:53:41,144 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-14 14:53:41,144 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-14 14:53:41,144 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:41,144 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:41,145 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:53:41,145 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:41,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:53:41,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:53:41,146 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:41,146 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:53:41,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:41,146 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:41,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:53:41,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:41,147 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:41,147 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-14 14:53:41,147 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:41,147 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-14 14:53:41,147 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:53:41,147 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-14 14:53:41,147 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 14:53:41,147 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:53:41,147 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1678805613006.984e5359c7c1d404d5a6dab33d5d90f1. 2023-03-14 14:53:41,147 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1678805613006.984e5359c7c1d404d5a6dab33d5d90f1. started... 2023-03-14 14:53:41,148 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 984e5359c7c1d404d5a6dab33d5d90f1 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 14:53:41,563 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601010b138ebc40a74c68928d799652969769 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601010b138ebc40a74c68928d799652969769 2023-03-14 14:53:41,971 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/.tmp/family1/e20f67ca57304f0f914cf2439335844a 2023-03-14 14:53:41,985 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/.tmp/family1/e20f67ca57304f0f914cf2439335844a as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/e20f67ca57304f0f914cf2439335844a 2023-03-14 14:53:41,989 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/e20f67ca57304f0f914cf2439335844a, entries=1, sequenceid=29, filesize=4.9 K 2023-03-14 14:53:41,990 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 984e5359c7c1d404d5a6dab33d5d90f1 in 842ms, sequenceid=29, compaction requested=true 2023-03-14 14:53:41,990 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 984e5359c7c1d404d5a6dab33d5d90f1: 2023-03-14 14:53:41,990 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1678805613006.984e5359c7c1d404d5a6dab33d5d90f1. 2023-03-14 14:53:41,990 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 14:53:41,990 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 14:53:41,990 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:41,991 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-14 14:53:41,991 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-14 14:53:41,992 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:41,992 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:41,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:41,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:41,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:41,992 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:41,992 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:53:41,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:41,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:41,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:41,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:41,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:41,993 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-14 14:53:41,993 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1d09d0ed[Count = 0] remaining members to acquire global barrier 2023-03-14 14:53:41,993 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-14 14:53:41,994 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:41,994 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:41,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:41,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:41,994 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-14 14:53:41,995 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-14 14:53:41,995 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:53:41,995 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:41,995 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:53:41,996 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-14 14:53:41,996 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:41,996 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:53:41,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:41,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:41,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:41,996 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-14 14:53:41,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:41,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:41,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:41,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:41,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:41,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:41,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:41,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:53:41,999 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-14 14:53:41,999 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-14 14:53:41,999 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:53:41,999 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:53:41,999 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:42,000 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:53:42,001 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:42,001 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:42,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:42,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:42,001 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:53:42,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:42,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:42,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:42,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:53:42,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:53:42,001 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:42,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:42,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:42,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:42,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:42,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:42,003 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:42,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:42,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:42,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:42,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:42,004 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:42,004 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:42,005 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:53:42,005 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:53:42,005 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:42,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:53:42,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:53:42,005 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-14 14:53:42,005 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:53:42,005 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:53:42,005 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:42,005 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-14 14:53:42,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:53:42,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:53:42,005 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:42,005 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-14 14:53:42,005 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:42,005 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:53:42,005 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:42,106 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:53:42,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:53:42,118 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:53:42,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-14 14:53:42,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:42,121 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-14 14:53:42,121 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:53:42,121 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-14 14:53:42,121 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-14 14:53:42,122 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:42,122 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:42,123 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:53:42,123 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:42,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:53:42,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:53:42,123 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:42,123 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:53:42,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:42,123 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:42,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:53:42,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:42,124 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:42,124 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-14 14:53:42,124 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:42,124 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-14 14:53:42,124 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:53:42,124 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-14 14:53:42,124 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 14:53:42,124 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:53:42,124 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1678805613006.984e5359c7c1d404d5a6dab33d5d90f1. 2023-03-14 14:53:42,124 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1678805613006.984e5359c7c1d404d5a6dab33d5d90f1. started... 2023-03-14 14:53:42,124 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 984e5359c7c1d404d5a6dab33d5d90f1 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 14:53:42,545 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103ee2afce03ff2452cb34977a5a2f935cd to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103ee2afce03ff2452cb34977a5a2f935cd 2023-03-14 14:53:42,952 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/.tmp/family1/2f694ca92f844eaab21e57ba571835bd 2023-03-14 14:53:42,963 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/.tmp/family1/2f694ca92f844eaab21e57ba571835bd as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/2f694ca92f844eaab21e57ba571835bd 2023-03-14 14:53:42,969 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/2f694ca92f844eaab21e57ba571835bd, entries=1, sequenceid=33, filesize=4.9 K 2023-03-14 14:53:42,970 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 984e5359c7c1d404d5a6dab33d5d90f1 in 846ms, sequenceid=33, compaction requested=true 2023-03-14 14:53:42,971 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 984e5359c7c1d404d5a6dab33d5d90f1: 2023-03-14 14:53:42,971 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1678805613006.984e5359c7c1d404d5a6dab33d5d90f1. 2023-03-14 14:53:42,971 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 14:53:42,971 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 14:53:42,971 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:42,971 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-14 14:53:42,971 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-14 14:53:42,972 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:42,972 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:42,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:42,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:42,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:42,972 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:42,972 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:53:42,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:42,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:42,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:42,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:42,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:42,974 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-14 14:53:42,974 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7c07050c[Count = 0] remaining members to acquire global barrier 2023-03-14 14:53:42,974 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-14 14:53:42,974 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:42,974 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:42,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:42,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:42,975 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-14 14:53:42,975 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-14 14:53:42,975 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:53:42,975 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:42,975 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:53:42,976 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-14 14:53:42,976 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:42,976 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:53:42,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:42,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:42,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:42,976 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-14 14:53:42,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:42,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:42,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:42,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:42,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:42,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:42,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:42,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:53:42,978 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-14 14:53:42,978 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-14 14:53:42,978 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:53:42,978 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:53:42,978 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:42,978 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:53:42,979 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:42,979 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:42,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:42,979 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:53:42,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:42,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:42,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:42,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:42,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:53:42,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:53:42,979 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:42,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:42,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:42,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:42,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:42,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:42,980 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:42,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:42,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:42,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:42,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:42,981 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:42,982 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:42,982 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:53:42,982 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:42,982 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-14 14:53:42,982 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:53:42,982 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-14 14:53:42,982 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:42,982 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:53:42,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:53:42,982 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:53:42,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:53:42,982 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-14 14:53:42,982 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:42,982 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:53:42,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:53:42,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:53:42,982 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:42,982 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:43,082 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:53:43,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:53:43,094 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:53:43,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-14 14:53:43,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:43,096 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-14 14:53:43,096 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:53:43,096 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-14 14:53:43,096 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-14 14:53:43,096 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:43,097 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:43,098 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:53:43,098 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:43,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:53:43,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:53:43,098 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:43,098 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:53:43,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:43,099 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:43,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:53:43,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:43,099 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:43,100 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-14 14:53:43,100 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:43,100 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-14 14:53:43,100 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:53:43,100 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-14 14:53:43,100 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 14:53:43,100 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:53:43,100 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1678805613006.984e5359c7c1d404d5a6dab33d5d90f1. 2023-03-14 14:53:43,100 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1678805613006.984e5359c7c1d404d5a6dab33d5d90f1. started... 2023-03-14 14:53:43,100 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 984e5359c7c1d404d5a6dab33d5d90f1 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 14:53:43,526 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907d573e3cf450f4b94912ad67ec65a226c to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20150907d573e3cf450f4b94912ad67ec65a226c 2023-03-14 14:53:43,937 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/.tmp/family1/330f70de26da427b84ef3ebce65d90af 2023-03-14 14:53:43,944 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/.tmp/family1/330f70de26da427b84ef3ebce65d90af as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/330f70de26da427b84ef3ebce65d90af 2023-03-14 14:53:43,949 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/330f70de26da427b84ef3ebce65d90af, entries=1, sequenceid=37, filesize=4.9 K 2023-03-14 14:53:43,950 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 984e5359c7c1d404d5a6dab33d5d90f1 in 850ms, sequenceid=37, compaction requested=true 2023-03-14 14:53:43,950 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 984e5359c7c1d404d5a6dab33d5d90f1: 2023-03-14 14:53:43,950 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1678805613006.984e5359c7c1d404d5a6dab33d5d90f1. 2023-03-14 14:53:43,950 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 14:53:43,951 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 14:53:43,951 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:43,951 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-14 14:53:43,951 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-14 14:53:43,953 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:43,953 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:43,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:43,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:43,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:43,953 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:43,953 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:53:43,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:43,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:43,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:43,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:43,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:43,955 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-14 14:53:43,955 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@343f01e0[Count = 0] remaining members to acquire global barrier 2023-03-14 14:53:43,955 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-14 14:53:43,955 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:43,956 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:43,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:43,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:43,956 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-14 14:53:43,956 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-14 14:53:43,956 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:43,956 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:53:43,956 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:53:43,957 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:43,957 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-14 14:53:43,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:43,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:43,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:43,957 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:53:43,957 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-14 14:53:43,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:43,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:43,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:43,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:43,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:43,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:43,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:43,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:53:43,959 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-14 14:53:43,959 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-14 14:53:43,959 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:53:43,959 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:53:43,959 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:43,959 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:53:43,960 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:43,960 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:43,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:43,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:43,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:43,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:43,960 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:53:43,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:43,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:43,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:53:43,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:53:43,960 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:43,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:43,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:43,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:43,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:43,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:43,961 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:43,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:43,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:43,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:43,962 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:43,962 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:53:43,962 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:43,962 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:53:43,962 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:53:43,962 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:43,962 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-14 14:53:43,963 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:53:43,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:53:43,963 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:43,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:53:43,963 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:43,963 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:43,963 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:43,963 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-14 14:53:43,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:53:43,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:53:43,963 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:53:44,063 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:53:44,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:53:44,075 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:53:44,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-14 14:53:44,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:44,079 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-03-14 14:53:44,079 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:53:44,079 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-14 14:53:44,079 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-14 14:53:44,080 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:44,080 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:44,081 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:53:44,081 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:44,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:53:44,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:53:44,081 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:44,082 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:53:44,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:44,082 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:44,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:53:44,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:44,082 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:44,083 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-03-14 14:53:44,083 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:44,083 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-14 14:53:44,083 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:53:44,083 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-14 14:53:44,083 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 14:53:44,083 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:53:44,083 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1678805613006.984e5359c7c1d404d5a6dab33d5d90f1. 2023-03-14 14:53:44,083 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1678805613006.984e5359c7c1d404d5a6dab33d5d90f1. started... 2023-03-14 14:53:44,083 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 984e5359c7c1d404d5a6dab33d5d90f1 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 14:53:44,507 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120ae561e545238458c8b69cc930cddeb70 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151120ae561e545238458c8b69cc930cddeb70 2023-03-14 14:53:44,914 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/.tmp/family1/e9dc4877e45d473793352a1aa17ced30 2023-03-14 14:53:44,926 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/.tmp/family1/e9dc4877e45d473793352a1aa17ced30 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/e9dc4877e45d473793352a1aa17ced30 2023-03-14 14:53:44,932 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/e9dc4877e45d473793352a1aa17ced30, entries=1, sequenceid=41, filesize=4.9 K 2023-03-14 14:53:44,933 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 984e5359c7c1d404d5a6dab33d5d90f1 in 850ms, sequenceid=41, compaction requested=true 2023-03-14 14:53:44,933 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 984e5359c7c1d404d5a6dab33d5d90f1: 2023-03-14 14:53:44,933 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1678805613006.984e5359c7c1d404d5a6dab33d5d90f1. 2023-03-14 14:53:44,933 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 14:53:44,933 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 14:53:44,933 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:44,933 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-03-14 14:53:44,933 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-03-14 14:53:44,934 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:44,934 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:44,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:44,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:44,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:44,935 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:44,935 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:53:44,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:44,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:44,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:44,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:44,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:44,936 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-03-14 14:53:44,936 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@500409f9[Count = 0] remaining members to acquire global barrier 2023-03-14 14:53:44,936 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-14 14:53:44,936 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:44,937 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:44,937 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:44,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:44,937 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-14 14:53:44,937 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-03-14 14:53:44,937 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:53:44,937 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:44,937 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:53:44,938 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-14 14:53:44,938 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:44,938 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:53:44,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:44,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:44,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:44,938 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-03-14 14:53:44,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:44,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:44,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:44,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:44,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:44,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:44,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:44,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:53:44,940 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-14 14:53:44,940 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-03-14 14:53:44,940 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:53:44,940 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:53:44,940 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:44,940 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:53:44,941 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:44,941 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:44,941 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:44,941 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:53:44,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:44,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:44,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:44,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:44,941 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:53:44,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:53:44,941 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:44,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:44,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:44,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:44,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:44,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:44,942 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:44,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:44,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:44,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:44,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:44,943 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:44,943 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:44,943 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-03-14 14:53:44,944 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:53:44,943 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:53:44,944 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:53:44,944 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-14 14:53:44,943 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:44,944 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:53:44,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:53:44,944 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:53:44,944 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-14 14:53:44,944 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:44,944 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:53:44,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:53:44,944 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:53:44,944 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:44,944 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:44,944 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:45,044 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:53:45,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:53:45,048 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=38031] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMinorCompactionWithWeeklyPolicy 2023-03-14 14:53:45,051 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-03-14 14:53:45,053 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-03-14 14:53:45,054 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-14 14:53:45,054 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=26, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678806225054 2023-03-14 14:53:45,058 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-03-14 14:53:45,059 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 0 del files, 9 selected files, and 0 irrelevant files table 'testMinorCompactionWithWeeklyPolicy' and column 'family1' 2023-03-14 14:53:45,059 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-03-14 14:53:45,060 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] zookeeper.ReadOnlyZKClient(139): Connect 0x4689ef6f to 127.0.0.1:50211 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-14 14:53:45,063 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7c3fefc7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-14 14:53:45,064 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-14 14:53:45,921 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103dbcf68d8304c4694a211b600a82ab633 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103dbcf68d8304c4694a211b600a82ab633 2023-03-14 14:53:45,922 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-03-14 14:53:45,936 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-14 14:53:45,937 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:43874, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-14 14:53:45,944 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-14 14:53:45,946 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:53310, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-14 14:53:45,957 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/345a919b0c69445d9ecc82b50063bca5 first=Optional[r3] last=Optional[r6] 2023-03-14 14:53:45,957 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1678805613006.984e5359c7c1d404d5a6dab33d5d90f1., hostname=jenkins-hbase20.apache.org,41317,1678805580877, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/345a919b0c69445d9ecc82b50063bca5}] 2023-03-14 14:53:45,964 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/345a919b0c69445d9ecc82b50063bca5 for inclusion in 984e5359c7c1d404d5a6dab33d5d90f1/family1 2023-03-14 14:53:45,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-03-14 14:53:45,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(777): Region bounds: first= last= 2023-03-14 14:53:45,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HRegion(2446): Flush status journal for 984e5359c7c1d404d5a6dab33d5d90f1: 2023-03-14 14:53:45,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/345a919b0c69445d9ecc82b50063bca5 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMinorCompactionWithWeeklyPolicy__arqnb522nfni5aqd4u7ra13dk9egihv355hvg6ged7cr0tn7r23ktkgc1tlekvcd/family1/345a919b0c69445d9ecc82b50063bca5 2023-03-14 14:53:45,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMinorCompactionWithWeeklyPolicy__arqnb522nfni5aqd4u7ra13dk9egihv355hvg6ged7cr0tn7r23ktkgc1tlekvcd/family1/345a919b0c69445d9ecc82b50063bca5 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/18cb670d5de4433aa301e917ebe0e6b1_SeqId_44_ 2023-03-14 14:53:45,973 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMinorCompactionWithWeeklyPolicy__arqnb522nfni5aqd4u7ra13dk9egihv355hvg6ged7cr0tn7r23ktkgc1tlekvcd/family1/345a919b0c69445d9ecc82b50063bca5 into 984e5359c7c1d404d5a6dab33d5d90f1/family1 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/18cb670d5de4433aa301e917ebe0e6b1_SeqId_44_ - updating store file list. 2023-03-14 14:53:45,978 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/18cb670d5de4433aa301e917ebe0e6b1_SeqId_44_ into 984e5359c7c1d404d5a6dab33d5d90f1/family1 2023-03-14 14:53:45,978 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMinorCompactionWithWeeklyPolicy__arqnb522nfni5aqd4u7ra13dk9egihv355hvg6ged7cr0tn7r23ktkgc1tlekvcd/family1/345a919b0c69445d9ecc82b50063bca5 into 984e5359c7c1d404d5a6dab33d5d90f1/family1 (new location: hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/18cb670d5de4433aa301e917ebe0e6b1_SeqId_44_) 2023-03-14 14:53:45,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMinorCompactionWithWeeklyPolicy__arqnb522nfni5aqd4u7ra13dk9egihv355hvg6ged7cr0tn7r23ktkgc1tlekvcd/family1/345a919b0c69445d9ecc82b50063bca5 2023-03-14 14:53:45,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-14 14:53:45,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-14 14:53:45,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(1912): 984e5359c7c1d404d5a6dab33d5d90f1/family1 is initiating minor compaction 2023-03-14 14:53:45,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@45c25cf0; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-14 14:53:45,982 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 984e5359c7c1d404d5a6dab33d5d90f1/family1 in testMinorCompactionWithWeeklyPolicy,,1678805613006.984e5359c7c1d404d5a6dab33d5d90f1. 2023-03-14 14:53:45,982 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/8160888bf3ee4ca986aac3cea18515d5, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/5dc3177c6518407b8585f68dcdcdb216, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/0c3bba70c773484e89f9d0b67370f07f, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/6b6c2eda5ef5473ab5a3c1072f596fa8, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/b6b97acc2ce440c3bbc38cc84f89a850, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/e20f67ca57304f0f914cf2439335844a, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/2f694ca92f844eaab21e57ba571835bd, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/330f70de26da427b84ef3ebce65d90af, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/e9dc4877e45d473793352a1aa17ced30, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/18cb670d5de4433aa301e917ebe0e6b1_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/.tmp, totalSize=50.0 K 2023-03-14 14:53:45,982 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting 8160888bf3ee4ca986aac3cea18515d5, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-14 14:53:45,982 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting 5dc3177c6518407b8585f68dcdcdb216, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-14 14:53:45,982 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting 0c3bba70c773484e89f9d0b67370f07f, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-14 14:53:45,982 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting 6b6c2eda5ef5473ab5a3c1072f596fa8, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-14 14:53:45,983 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting b6b97acc2ce440c3bbc38cc84f89a850, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-14 14:53:45,983 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting e20f67ca57304f0f914cf2439335844a, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-14 14:53:45,983 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting 2f694ca92f844eaab21e57ba571835bd, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-14 14:53:45,983 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting 330f70de26da427b84ef3ebce65d90af, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-14 14:53:45,983 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting e9dc4877e45d473793352a1aa17ced30, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-14 14:53:45,983 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting 18cb670d5de4433aa301e917ebe0e6b1_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-14 14:53:45,984 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-03-14 14:53:45,985 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 14:53:45,986 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228c6382b7680d7471dad4c041f4d9a92a5 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228c6382b7680d7471dad4c041f4d9a92a5 2023-03-14 14:53:45,987 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015123147e4da906aa64446bf9523da9c8f6ae9 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015123147e4da906aa64446bf9523da9c8f6ae9 2023-03-14 14:53:45,988 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601010b138ebc40a74c68928d799652969769 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601010b138ebc40a74c68928d799652969769 2023-03-14 14:53:45,989 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103ee2afce03ff2452cb34977a5a2f935cd to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103ee2afce03ff2452cb34977a5a2f935cd 2023-03-14 14:53:45,989 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-03-14 14:53:45,989 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-03-14 14:53:45,990 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-14 14:53:45,990 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-14 14:53:45,990 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-14 14:53:45,990 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-14 14:53:45,990 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-14 14:53:45,990 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-14 14:53:45,990 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-14 14:53:45,990 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-14 14:53:46,029 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] throttle.PressureAwareThroughputController(145): 984e5359c7c1d404d5a6dab33d5d90f1#family1#compaction#34 average throughput is 0.45 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-14 14:53:46,835 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120507537633b9d545bfb802a09fb8818b11 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120507537633b9d545bfb802a09fb8818b11 2023-03-14 14:53:46,836 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-03-14 14:53:46,855 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/.tmp/family1/96cda65038054e51b7d8df7551755563 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/96cda65038054e51b7d8df7551755563 2023-03-14 14:53:46,862 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 984e5359c7c1d404d5a6dab33d5d90f1/family1 of 984e5359c7c1d404d5a6dab33d5d90f1 into 96cda65038054e51b7d8df7551755563(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-14 14:53:46,862 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 984e5359c7c1d404d5a6dab33d5d90f1: 2023-03-14 14:53:46,862 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1678805613006.984e5359c7c1d404d5a6dab33d5d90f1., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1678805625982; duration=0sec 2023-03-14 14:53:46,862 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-14 14:53:46,862 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/8e57981405494744bb3399ade7741be1 first=Optional[r1] last=Optional[r2] 2023-03-14 14:53:46,863 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1678805613006.984e5359c7c1d404d5a6dab33d5d90f1., hostname=jenkins-hbase20.apache.org,41317,1678805580877, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/8e57981405494744bb3399ade7741be1}] 2023-03-14 14:53:46,866 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/8e57981405494744bb3399ade7741be1 for inclusion in 984e5359c7c1d404d5a6dab33d5d90f1/family1 2023-03-14 14:53:46,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-03-14 14:53:46,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(777): Region bounds: first= last= 2023-03-14 14:53:46,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HRegion(2446): Flush status journal for 984e5359c7c1d404d5a6dab33d5d90f1: 2023-03-14 14:53:46,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/8e57981405494744bb3399ade7741be1 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMinorCompactionWithWeeklyPolicy__fnkh2arm17lt5h1l1871iq4a085sp7m4e2bfcmsssqnggp1qs2mucn4l8erhs6th/family1/8e57981405494744bb3399ade7741be1 2023-03-14 14:53:46,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMinorCompactionWithWeeklyPolicy__fnkh2arm17lt5h1l1871iq4a085sp7m4e2bfcmsssqnggp1qs2mucn4l8erhs6th/family1/8e57981405494744bb3399ade7741be1 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/f87f5d3f59184fdfae99c2b2013c7d72_SeqId_47_ 2023-03-14 14:53:46,873 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMinorCompactionWithWeeklyPolicy__fnkh2arm17lt5h1l1871iq4a085sp7m4e2bfcmsssqnggp1qs2mucn4l8erhs6th/family1/8e57981405494744bb3399ade7741be1 into 984e5359c7c1d404d5a6dab33d5d90f1/family1 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/f87f5d3f59184fdfae99c2b2013c7d72_SeqId_47_ - updating store file list. 2023-03-14 14:53:46,876 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/f87f5d3f59184fdfae99c2b2013c7d72_SeqId_47_ into 984e5359c7c1d404d5a6dab33d5d90f1/family1 2023-03-14 14:53:46,876 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMinorCompactionWithWeeklyPolicy__fnkh2arm17lt5h1l1871iq4a085sp7m4e2bfcmsssqnggp1qs2mucn4l8erhs6th/family1/8e57981405494744bb3399ade7741be1 into 984e5359c7c1d404d5a6dab33d5d90f1/family1 (new location: hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/f87f5d3f59184fdfae99c2b2013c7d72_SeqId_47_) 2023-03-14 14:53:46,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMinorCompactionWithWeeklyPolicy__fnkh2arm17lt5h1l1871iq4a085sp7m4e2bfcmsssqnggp1qs2mucn4l8erhs6th/family1/8e57981405494744bb3399ade7741be1 2023-03-14 14:53:46,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-14 14:53:46,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 181014 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-14 14:53:46,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(1912): 984e5359c7c1d404d5a6dab33d5d90f1/family1 is initiating minor compaction (all files) 2023-03-14 14:53:46,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@60e5dc0; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-14 14:53:46,878 INFO [RS:0;jenkins-hbase20:41317-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 984e5359c7c1d404d5a6dab33d5d90f1/family1 in testMinorCompactionWithWeeklyPolicy,,1678805613006.984e5359c7c1d404d5a6dab33d5d90f1. 2023-03-14 14:53:46,878 INFO [RS:0;jenkins-hbase20:41317-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/6af66b28e98849239ba551917d2648e8, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/96cda65038054e51b7d8df7551755563, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/f87f5d3f59184fdfae99c2b2013c7d72_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/.tmp, totalSize=176.8 K 2023-03-14 14:53:46,879 DEBUG [RS:0;jenkins-hbase20:41317-longCompactions-0] compactions.Compactor(207): Compacting 6af66b28e98849239ba551917d2648e8, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878806007 2023-03-14 14:53:46,879 DEBUG [RS:0;jenkins-hbase20:41317-longCompactions-0] compactions.Compactor(207): Compacting 96cda65038054e51b7d8df7551755563, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621206007 2023-03-14 14:53:46,880 DEBUG [RS:0;jenkins-hbase20:41317-longCompactions-0] compactions.Compactor(207): Compacting f87f5d3f59184fdfae99c2b2013c7d72_SeqId_47_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965206007 2023-03-14 14:53:46,880 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-03-14 14:53:46,881 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 14:53:46,882 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512010ef8fc832787410f866b69e032506727 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512010ef8fc832787410f866b69e032506727 2023-03-14 14:53:46,883 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205abd26d3804544db9865927ac2bdd1bd2 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205abd26d3804544db9865927ac2bdd1bd2 2023-03-14 14:53:46,883 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 2 expired mob files are deleted 2023-03-14 14:53:46,883 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-03-14 14:53:46,884 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-03-14 14:53:46,884 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-03-14 14:53:46,884 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-14 14:53:46,886 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=26, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-03-14 14:53:46,887 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.8370 sec 2023-03-14 14:53:46,897 INFO [RS:0;jenkins-hbase20:41317-longCompactions-0] throttle.PressureAwareThroughputController(145): 984e5359c7c1d404d5a6dab33d5d90f1#family1#compaction#35 average throughput is 17.18 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-14 14:53:46,923 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/8160888bf3ee4ca986aac3cea18515d5, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/5dc3177c6518407b8585f68dcdcdb216, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/0c3bba70c773484e89f9d0b67370f07f, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/6b6c2eda5ef5473ab5a3c1072f596fa8, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/b6b97acc2ce440c3bbc38cc84f89a850, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/e20f67ca57304f0f914cf2439335844a, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/2f694ca92f844eaab21e57ba571835bd, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/330f70de26da427b84ef3ebce65d90af, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/e9dc4877e45d473793352a1aa17ced30, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/18cb670d5de4433aa301e917ebe0e6b1_SeqId_44_] to archive 2023-03-14 14:53:46,924 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 14:53:46,926 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/8160888bf3ee4ca986aac3cea18515d5 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/8160888bf3ee4ca986aac3cea18515d5 2023-03-14 14:53:46,927 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/5dc3177c6518407b8585f68dcdcdb216 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/5dc3177c6518407b8585f68dcdcdb216 2023-03-14 14:53:46,928 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/0c3bba70c773484e89f9d0b67370f07f to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/0c3bba70c773484e89f9d0b67370f07f 2023-03-14 14:53:46,929 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/6b6c2eda5ef5473ab5a3c1072f596fa8 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/6b6c2eda5ef5473ab5a3c1072f596fa8 2023-03-14 14:53:46,930 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/b6b97acc2ce440c3bbc38cc84f89a850 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/b6b97acc2ce440c3bbc38cc84f89a850 2023-03-14 14:53:46,931 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/e20f67ca57304f0f914cf2439335844a to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/e20f67ca57304f0f914cf2439335844a 2023-03-14 14:53:46,933 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/2f694ca92f844eaab21e57ba571835bd to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/2f694ca92f844eaab21e57ba571835bd 2023-03-14 14:53:46,934 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/330f70de26da427b84ef3ebce65d90af to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/330f70de26da427b84ef3ebce65d90af 2023-03-14 14:53:46,936 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/e9dc4877e45d473793352a1aa17ced30 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/e9dc4877e45d473793352a1aa17ced30 2023-03-14 14:53:46,937 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/18cb670d5de4433aa301e917ebe0e6b1_SeqId_44_ to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/18cb670d5de4433aa301e917ebe0e6b1_SeqId_44_ 2023-03-14 14:53:46,991 INFO [Listener at localhost.localdomain/44261] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=254 (was 255), OpenFileDescriptor=596 (was 604), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=282 (was 332), ProcessCount=172 (was 169) - ProcessCount LEAK? -, AvailableMemoryMB=12536 (was 12634) 2023-03-14 14:53:47,000 INFO [Listener at localhost.localdomain/44261] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=254, OpenFileDescriptor=596, MaxFileDescriptor=60000, SystemLoadAverage=282, ProcessCount=172, AvailableMemoryMB=12535 2023-03-14 14:53:47,002 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-03-14 14:53:47,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles 2023-03-14 14:53:47,005 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_PRE_OPERATION 2023-03-14 14:53:47,005 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testScannerOnBulkLoadRefHFiles" procId is: 27 2023-03-14 14:53:47,006 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-14 14:53:47,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-03-14 14:53:47,008 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/default/testScannerOnBulkLoadRefHFiles/3ea13ff804537f3e856a240e0067a94c 2023-03-14 14:53:47,008 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/default/testScannerOnBulkLoadRefHFiles/7eb84d1cb8ce303dd656f6348c25f0e3 2023-03-14 14:53:47,008 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/default/testScannerOnBulkLoadRefHFiles/4fc16beb64e446f8e20e521dacdaf408 2023-03-14 14:53:47,008 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/default/testScannerOnBulkLoadRefHFiles/3ea13ff804537f3e856a240e0067a94c empty. 2023-03-14 14:53:47,008 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/default/testScannerOnBulkLoadRefHFiles/7eb84d1cb8ce303dd656f6348c25f0e3 empty. 2023-03-14 14:53:47,008 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/default/testScannerOnBulkLoadRefHFiles/4fc16beb64e446f8e20e521dacdaf408 empty. 2023-03-14 14:53:47,009 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/default/testScannerOnBulkLoadRefHFiles/3ea13ff804537f3e856a240e0067a94c 2023-03-14 14:53:47,009 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/default/testScannerOnBulkLoadRefHFiles/7eb84d1cb8ce303dd656f6348c25f0e3 2023-03-14 14:53:47,009 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/default/testScannerOnBulkLoadRefHFiles/4fc16beb64e446f8e20e521dacdaf408 2023-03-14 14:53:47,009 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testScannerOnBulkLoadRefHFiles regions 2023-03-14 14:53:47,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-03-14 14:53:47,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-03-14 14:53:47,419 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/default/testScannerOnBulkLoadRefHFiles/.tabledesc/.tableinfo.0000000001 2023-03-14 14:53:47,421 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(7675): creating {ENCODED => 3ea13ff804537f3e856a240e0067a94c, NAME => 'testScannerOnBulkLoadRefHFiles,,1678805627002.3ea13ff804537f3e856a240e0067a94c.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp 2023-03-14 14:53:47,423 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(7675): creating {ENCODED => 7eb84d1cb8ce303dd656f6348c25f0e3, NAME => 'testScannerOnBulkLoadRefHFiles,1,1678805627002.7eb84d1cb8ce303dd656f6348c25f0e3.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp 2023-03-14 14:53:47,423 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(7675): creating {ENCODED => 4fc16beb64e446f8e20e521dacdaf408, NAME => 'testScannerOnBulkLoadRefHFiles,2,1678805627002.4fc16beb64e446f8e20e521dacdaf408.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp 2023-03-14 14:53:47,438 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1678805627002.3ea13ff804537f3e856a240e0067a94c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 14:53:47,438 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1604): Closing 3ea13ff804537f3e856a240e0067a94c, disabling compactions & flushes 2023-03-14 14:53:47,438 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1678805627002.3ea13ff804537f3e856a240e0067a94c. 2023-03-14 14:53:47,438 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1678805627002.3ea13ff804537f3e856a240e0067a94c. 2023-03-14 14:53:47,438 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1678805627002.3ea13ff804537f3e856a240e0067a94c. after waiting 0 ms 2023-03-14 14:53:47,438 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1678805627002.3ea13ff804537f3e856a240e0067a94c. 2023-03-14 14:53:47,438 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1678805627002.3ea13ff804537f3e856a240e0067a94c. 2023-03-14 14:53:47,438 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1558): Region close journal for 3ea13ff804537f3e856a240e0067a94c: 2023-03-14 14:53:47,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-03-14 14:53:47,837 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1678805627002.7eb84d1cb8ce303dd656f6348c25f0e3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 14:53:47,837 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1604): Closing 7eb84d1cb8ce303dd656f6348c25f0e3, disabling compactions & flushes 2023-03-14 14:53:47,837 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1678805627002.7eb84d1cb8ce303dd656f6348c25f0e3. 2023-03-14 14:53:47,837 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1678805627002.7eb84d1cb8ce303dd656f6348c25f0e3. 2023-03-14 14:53:47,837 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1678805627002.7eb84d1cb8ce303dd656f6348c25f0e3. after waiting 0 ms 2023-03-14 14:53:47,837 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1678805627002.7eb84d1cb8ce303dd656f6348c25f0e3. 2023-03-14 14:53:47,838 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1678805627002.7eb84d1cb8ce303dd656f6348c25f0e3. 2023-03-14 14:53:47,838 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1678805627002.4fc16beb64e446f8e20e521dacdaf408.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 14:53:47,838 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1558): Region close journal for 7eb84d1cb8ce303dd656f6348c25f0e3: 2023-03-14 14:53:47,838 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1604): Closing 4fc16beb64e446f8e20e521dacdaf408, disabling compactions & flushes 2023-03-14 14:53:47,838 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1678805627002.4fc16beb64e446f8e20e521dacdaf408. 2023-03-14 14:53:47,839 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1678805627002.4fc16beb64e446f8e20e521dacdaf408. 2023-03-14 14:53:47,839 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1678805627002.4fc16beb64e446f8e20e521dacdaf408. after waiting 0 ms 2023-03-14 14:53:47,839 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1678805627002.4fc16beb64e446f8e20e521dacdaf408. 2023-03-14 14:53:47,839 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1678805627002.4fc16beb64e446f8e20e521dacdaf408. 2023-03-14 14:53:47,839 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1558): Region close journal for 4fc16beb64e446f8e20e521dacdaf408: 2023-03-14 14:53:47,844 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ADD_TO_META 2023-03-14 14:53:47,845 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,,1678805627002.3ea13ff804537f3e856a240e0067a94c.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1678805627845"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678805627845"}]},"ts":"1678805627845"} 2023-03-14 14:53:47,845 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,1,1678805627002.7eb84d1cb8ce303dd656f6348c25f0e3.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1678805627845"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678805627845"}]},"ts":"1678805627845"} 2023-03-14 14:53:47,845 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,2,1678805627002.4fc16beb64e446f8e20e521dacdaf408.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1678805627845"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678805627845"}]},"ts":"1678805627845"} 2023-03-14 14:53:47,849 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-03-14 14:53:47,850 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-14 14:53:47,850 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678805627850"}]},"ts":"1678805627850"} 2023-03-14 14:53:47,852 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLING in hbase:meta 2023-03-14 14:53:47,854 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=3ea13ff804537f3e856a240e0067a94c, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=7eb84d1cb8ce303dd656f6348c25f0e3, ASSIGN}, {pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=4fc16beb64e446f8e20e521dacdaf408, ASSIGN}] 2023-03-14 14:53:47,856 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=4fc16beb64e446f8e20e521dacdaf408, ASSIGN 2023-03-14 14:53:47,856 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=7eb84d1cb8ce303dd656f6348c25f0e3, ASSIGN 2023-03-14 14:53:47,856 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=3ea13ff804537f3e856a240e0067a94c, ASSIGN 2023-03-14 14:53:47,856 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=3ea13ff804537f3e856a240e0067a94c, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,41317,1678805580877; forceNewPlan=false, retain=false 2023-03-14 14:53:47,856 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=4fc16beb64e446f8e20e521dacdaf408, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,41317,1678805580877; forceNewPlan=false, retain=false 2023-03-14 14:53:47,856 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=7eb84d1cb8ce303dd656f6348c25f0e3, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,41317,1678805580877; forceNewPlan=false, retain=false 2023-03-14 14:53:48,010 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=7eb84d1cb8ce303dd656f6348c25f0e3, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:48,010 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=3ea13ff804537f3e856a240e0067a94c, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:48,010 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=4fc16beb64e446f8e20e521dacdaf408, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:48,011 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,,1678805627002.3ea13ff804537f3e856a240e0067a94c.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1678805628010"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1678805628010"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678805628010"}]},"ts":"1678805628010"} 2023-03-14 14:53:48,010 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,1,1678805627002.7eb84d1cb8ce303dd656f6348c25f0e3.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1678805628010"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1678805628010"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678805628010"}]},"ts":"1678805628010"} 2023-03-14 14:53:48,011 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,2,1678805627002.4fc16beb64e446f8e20e521dacdaf408.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1678805628010"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1678805628010"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678805628010"}]},"ts":"1678805628010"} 2023-03-14 14:53:48,014 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 3ea13ff804537f3e856a240e0067a94c, server=jenkins-hbase20.apache.org,41317,1678805580877}] 2023-03-14 14:53:48,015 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=32, ppid=29, state=RUNNABLE; OpenRegionProcedure 7eb84d1cb8ce303dd656f6348c25f0e3, server=jenkins-hbase20.apache.org,41317,1678805580877}] 2023-03-14 14:53:48,016 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=33, ppid=30, state=RUNNABLE; OpenRegionProcedure 4fc16beb64e446f8e20e521dacdaf408, server=jenkins-hbase20.apache.org,41317,1678805580877}] 2023-03-14 14:53:48,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-03-14 14:53:48,134 DEBUG [RS:0;jenkins-hbase20:41317-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/.tmp/family1/1e2f69cca4ef40778198108303f7b246 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/1e2f69cca4ef40778198108303f7b246 2023-03-14 14:53:48,139 INFO [RS:0;jenkins-hbase20:41317-longCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 984e5359c7c1d404d5a6dab33d5d90f1/family1 of 984e5359c7c1d404d5a6dab33d5d90f1 into 1e2f69cca4ef40778198108303f7b246(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-14 14:53:48,140 DEBUG [RS:0;jenkins-hbase20:41317-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 984e5359c7c1d404d5a6dab33d5d90f1: 2023-03-14 14:53:48,140 INFO [RS:0;jenkins-hbase20:41317-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1678805613006.984e5359c7c1d404d5a6dab33d5d90f1., storeName=family1, fileCount=3, fileSize=176.8 K (165.1 K, 6.6 K, 5.2 K), priority=2, time=1678805626878; duration=1sec 2023-03-14 14:53:48,140 DEBUG [RS:0;jenkins-hbase20:41317-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-14 14:53:48,171 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,1,1678805627002.7eb84d1cb8ce303dd656f6348c25f0e3. 2023-03-14 14:53:48,171 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7eb84d1cb8ce303dd656f6348c25f0e3, NAME => 'testScannerOnBulkLoadRefHFiles,1,1678805627002.7eb84d1cb8ce303dd656f6348c25f0e3.', STARTKEY => '1', ENDKEY => '2'} 2023-03-14 14:53:48,171 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 7eb84d1cb8ce303dd656f6348c25f0e3 2023-03-14 14:53:48,171 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1678805627002.7eb84d1cb8ce303dd656f6348c25f0e3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 14:53:48,171 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 7eb84d1cb8ce303dd656f6348c25f0e3 2023-03-14 14:53:48,171 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 7eb84d1cb8ce303dd656f6348c25f0e3 2023-03-14 14:53:48,173 INFO [StoreOpener-7eb84d1cb8ce303dd656f6348c25f0e3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 7eb84d1cb8ce303dd656f6348c25f0e3 2023-03-14 14:53:48,175 DEBUG [StoreOpener-7eb84d1cb8ce303dd656f6348c25f0e3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testScannerOnBulkLoadRefHFiles/7eb84d1cb8ce303dd656f6348c25f0e3/family1 2023-03-14 14:53:48,175 DEBUG [StoreOpener-7eb84d1cb8ce303dd656f6348c25f0e3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testScannerOnBulkLoadRefHFiles/7eb84d1cb8ce303dd656f6348c25f0e3/family1 2023-03-14 14:53:48,175 INFO [StoreOpener-7eb84d1cb8ce303dd656f6348c25f0e3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7eb84d1cb8ce303dd656f6348c25f0e3 columnFamilyName family1 2023-03-14 14:53:48,177 INFO [StoreOpener-7eb84d1cb8ce303dd656f6348c25f0e3-1] regionserver.HStore(310): Store=7eb84d1cb8ce303dd656f6348c25f0e3/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 14:53:48,178 INFO [StoreOpener-7eb84d1cb8ce303dd656f6348c25f0e3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 7eb84d1cb8ce303dd656f6348c25f0e3 2023-03-14 14:53:48,179 DEBUG [StoreOpener-7eb84d1cb8ce303dd656f6348c25f0e3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testScannerOnBulkLoadRefHFiles/7eb84d1cb8ce303dd656f6348c25f0e3/family2 2023-03-14 14:53:48,179 DEBUG [StoreOpener-7eb84d1cb8ce303dd656f6348c25f0e3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testScannerOnBulkLoadRefHFiles/7eb84d1cb8ce303dd656f6348c25f0e3/family2 2023-03-14 14:53:48,180 INFO [StoreOpener-7eb84d1cb8ce303dd656f6348c25f0e3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7eb84d1cb8ce303dd656f6348c25f0e3 columnFamilyName family2 2023-03-14 14:53:48,182 INFO [StoreOpener-7eb84d1cb8ce303dd656f6348c25f0e3-1] regionserver.HStore(310): Store=7eb84d1cb8ce303dd656f6348c25f0e3/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 14:53:48,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testScannerOnBulkLoadRefHFiles/7eb84d1cb8ce303dd656f6348c25f0e3 2023-03-14 14:53:48,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testScannerOnBulkLoadRefHFiles/7eb84d1cb8ce303dd656f6348c25f0e3 2023-03-14 14:53:48,186 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-14 14:53:48,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 7eb84d1cb8ce303dd656f6348c25f0e3 2023-03-14 14:53:48,190 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testScannerOnBulkLoadRefHFiles/7eb84d1cb8ce303dd656f6348c25f0e3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-14 14:53:48,191 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 7eb84d1cb8ce303dd656f6348c25f0e3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67429078, jitterRate=0.004771560430526733}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-14 14:53:48,191 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 7eb84d1cb8ce303dd656f6348c25f0e3: 2023-03-14 14:53:48,192 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,1,1678805627002.7eb84d1cb8ce303dd656f6348c25f0e3., pid=32, masterSystemTime=1678805628167 2023-03-14 14:53:48,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,1,1678805627002.7eb84d1cb8ce303dd656f6348c25f0e3. 2023-03-14 14:53:48,195 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,1,1678805627002.7eb84d1cb8ce303dd656f6348c25f0e3. 2023-03-14 14:53:48,195 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,2,1678805627002.4fc16beb64e446f8e20e521dacdaf408. 2023-03-14 14:53:48,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4fc16beb64e446f8e20e521dacdaf408, NAME => 'testScannerOnBulkLoadRefHFiles,2,1678805627002.4fc16beb64e446f8e20e521dacdaf408.', STARTKEY => '2', ENDKEY => ''} 2023-03-14 14:53:48,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 4fc16beb64e446f8e20e521dacdaf408 2023-03-14 14:53:48,195 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=7eb84d1cb8ce303dd656f6348c25f0e3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:48,196 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1678805627002.4fc16beb64e446f8e20e521dacdaf408.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 14:53:48,196 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 4fc16beb64e446f8e20e521dacdaf408 2023-03-14 14:53:48,196 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,1,1678805627002.7eb84d1cb8ce303dd656f6348c25f0e3.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1678805628195"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1678805628195"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678805628195"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678805628195"}]},"ts":"1678805628195"} 2023-03-14 14:53:48,196 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 4fc16beb64e446f8e20e521dacdaf408 2023-03-14 14:53:48,198 INFO [StoreOpener-4fc16beb64e446f8e20e521dacdaf408-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 4fc16beb64e446f8e20e521dacdaf408 2023-03-14 14:53:48,199 DEBUG [StoreOpener-4fc16beb64e446f8e20e521dacdaf408-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testScannerOnBulkLoadRefHFiles/4fc16beb64e446f8e20e521dacdaf408/family1 2023-03-14 14:53:48,200 DEBUG [StoreOpener-4fc16beb64e446f8e20e521dacdaf408-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testScannerOnBulkLoadRefHFiles/4fc16beb64e446f8e20e521dacdaf408/family1 2023-03-14 14:53:48,200 INFO [StoreOpener-4fc16beb64e446f8e20e521dacdaf408-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4fc16beb64e446f8e20e521dacdaf408 columnFamilyName family1 2023-03-14 14:53:48,200 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=32, resume processing ppid=29 2023-03-14 14:53:48,200 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=32, ppid=29, state=SUCCESS; OpenRegionProcedure 7eb84d1cb8ce303dd656f6348c25f0e3, server=jenkins-hbase20.apache.org,41317,1678805580877 in 183 msec 2023-03-14 14:53:48,201 INFO [StoreOpener-4fc16beb64e446f8e20e521dacdaf408-1] regionserver.HStore(310): Store=4fc16beb64e446f8e20e521dacdaf408/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 14:53:48,201 INFO [StoreOpener-4fc16beb64e446f8e20e521dacdaf408-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 4fc16beb64e446f8e20e521dacdaf408 2023-03-14 14:53:48,202 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=7eb84d1cb8ce303dd656f6348c25f0e3, ASSIGN in 346 msec 2023-03-14 14:53:48,203 DEBUG [StoreOpener-4fc16beb64e446f8e20e521dacdaf408-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testScannerOnBulkLoadRefHFiles/4fc16beb64e446f8e20e521dacdaf408/family2 2023-03-14 14:53:48,204 DEBUG [StoreOpener-4fc16beb64e446f8e20e521dacdaf408-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testScannerOnBulkLoadRefHFiles/4fc16beb64e446f8e20e521dacdaf408/family2 2023-03-14 14:53:48,205 INFO [StoreOpener-4fc16beb64e446f8e20e521dacdaf408-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4fc16beb64e446f8e20e521dacdaf408 columnFamilyName family2 2023-03-14 14:53:48,206 INFO [StoreOpener-4fc16beb64e446f8e20e521dacdaf408-1] regionserver.HStore(310): Store=4fc16beb64e446f8e20e521dacdaf408/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 14:53:48,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testScannerOnBulkLoadRefHFiles/4fc16beb64e446f8e20e521dacdaf408 2023-03-14 14:53:48,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testScannerOnBulkLoadRefHFiles/4fc16beb64e446f8e20e521dacdaf408 2023-03-14 14:53:48,211 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/6af66b28e98849239ba551917d2648e8, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/96cda65038054e51b7d8df7551755563, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/f87f5d3f59184fdfae99c2b2013c7d72_SeqId_47_] to archive 2023-03-14 14:53:48,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-14 14:53:48,212 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 14:53:48,212 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 4fc16beb64e446f8e20e521dacdaf408 2023-03-14 14:53:48,213 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/6af66b28e98849239ba551917d2648e8 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/6af66b28e98849239ba551917d2648e8 2023-03-14 14:53:48,214 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testScannerOnBulkLoadRefHFiles/4fc16beb64e446f8e20e521dacdaf408/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-14 14:53:48,214 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 4fc16beb64e446f8e20e521dacdaf408; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61749377, jitterRate=-0.079862579703331}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-14 14:53:48,214 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/96cda65038054e51b7d8df7551755563 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/96cda65038054e51b7d8df7551755563 2023-03-14 14:53:48,214 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 4fc16beb64e446f8e20e521dacdaf408: 2023-03-14 14:53:48,215 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,2,1678805627002.4fc16beb64e446f8e20e521dacdaf408., pid=33, masterSystemTime=1678805628167 2023-03-14 14:53:48,215 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/f87f5d3f59184fdfae99c2b2013c7d72_SeqId_47_ to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/family1/f87f5d3f59184fdfae99c2b2013c7d72_SeqId_47_ 2023-03-14 14:53:48,216 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,2,1678805627002.4fc16beb64e446f8e20e521dacdaf408. 2023-03-14 14:53:48,216 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,2,1678805627002.4fc16beb64e446f8e20e521dacdaf408. 2023-03-14 14:53:48,216 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,,1678805627002.3ea13ff804537f3e856a240e0067a94c. 2023-03-14 14:53:48,217 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3ea13ff804537f3e856a240e0067a94c, NAME => 'testScannerOnBulkLoadRefHFiles,,1678805627002.3ea13ff804537f3e856a240e0067a94c.', STARTKEY => '', ENDKEY => '1'} 2023-03-14 14:53:48,217 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=4fc16beb64e446f8e20e521dacdaf408, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:48,217 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 3ea13ff804537f3e856a240e0067a94c 2023-03-14 14:53:48,217 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1678805627002.3ea13ff804537f3e856a240e0067a94c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 14:53:48,217 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,2,1678805627002.4fc16beb64e446f8e20e521dacdaf408.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1678805628217"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1678805628217"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678805628217"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678805628217"}]},"ts":"1678805628217"} 2023-03-14 14:53:48,217 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 3ea13ff804537f3e856a240e0067a94c 2023-03-14 14:53:48,217 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 3ea13ff804537f3e856a240e0067a94c 2023-03-14 14:53:48,218 INFO [StoreOpener-3ea13ff804537f3e856a240e0067a94c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 3ea13ff804537f3e856a240e0067a94c 2023-03-14 14:53:48,220 DEBUG [StoreOpener-3ea13ff804537f3e856a240e0067a94c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testScannerOnBulkLoadRefHFiles/3ea13ff804537f3e856a240e0067a94c/family1 2023-03-14 14:53:48,220 DEBUG [StoreOpener-3ea13ff804537f3e856a240e0067a94c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testScannerOnBulkLoadRefHFiles/3ea13ff804537f3e856a240e0067a94c/family1 2023-03-14 14:53:48,220 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=33, resume processing ppid=30 2023-03-14 14:53:48,220 INFO [StoreOpener-3ea13ff804537f3e856a240e0067a94c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3ea13ff804537f3e856a240e0067a94c columnFamilyName family1 2023-03-14 14:53:48,220 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=33, ppid=30, state=SUCCESS; OpenRegionProcedure 4fc16beb64e446f8e20e521dacdaf408, server=jenkins-hbase20.apache.org,41317,1678805580877 in 202 msec 2023-03-14 14:53:48,221 INFO [StoreOpener-3ea13ff804537f3e856a240e0067a94c-1] regionserver.HStore(310): Store=3ea13ff804537f3e856a240e0067a94c/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 14:53:48,221 INFO [StoreOpener-3ea13ff804537f3e856a240e0067a94c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 3ea13ff804537f3e856a240e0067a94c 2023-03-14 14:53:48,221 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=4fc16beb64e446f8e20e521dacdaf408, ASSIGN in 366 msec 2023-03-14 14:53:48,222 DEBUG [StoreOpener-3ea13ff804537f3e856a240e0067a94c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testScannerOnBulkLoadRefHFiles/3ea13ff804537f3e856a240e0067a94c/family2 2023-03-14 14:53:48,222 DEBUG [StoreOpener-3ea13ff804537f3e856a240e0067a94c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testScannerOnBulkLoadRefHFiles/3ea13ff804537f3e856a240e0067a94c/family2 2023-03-14 14:53:48,223 INFO [StoreOpener-3ea13ff804537f3e856a240e0067a94c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3ea13ff804537f3e856a240e0067a94c columnFamilyName family2 2023-03-14 14:53:48,224 INFO [StoreOpener-3ea13ff804537f3e856a240e0067a94c-1] regionserver.HStore(310): Store=3ea13ff804537f3e856a240e0067a94c/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 14:53:48,224 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testScannerOnBulkLoadRefHFiles/3ea13ff804537f3e856a240e0067a94c 2023-03-14 14:53:48,225 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testScannerOnBulkLoadRefHFiles/3ea13ff804537f3e856a240e0067a94c 2023-03-14 14:53:48,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-14 14:53:48,227 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 3ea13ff804537f3e856a240e0067a94c 2023-03-14 14:53:48,229 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testScannerOnBulkLoadRefHFiles/3ea13ff804537f3e856a240e0067a94c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-14 14:53:48,229 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 3ea13ff804537f3e856a240e0067a94c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61533067, jitterRate=-0.08308584988117218}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-14 14:53:48,229 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 3ea13ff804537f3e856a240e0067a94c: 2023-03-14 14:53:48,230 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,,1678805627002.3ea13ff804537f3e856a240e0067a94c., pid=31, masterSystemTime=1678805628167 2023-03-14 14:53:48,232 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,,1678805627002.3ea13ff804537f3e856a240e0067a94c. 2023-03-14 14:53:48,232 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,,1678805627002.3ea13ff804537f3e856a240e0067a94c. 2023-03-14 14:53:48,232 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=3ea13ff804537f3e856a240e0067a94c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:48,232 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,,1678805627002.3ea13ff804537f3e856a240e0067a94c.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1678805628232"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1678805628232"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678805628232"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678805628232"}]},"ts":"1678805628232"} 2023-03-14 14:53:48,235 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=28 2023-03-14 14:53:48,236 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 3ea13ff804537f3e856a240e0067a94c, server=jenkins-hbase20.apache.org,41317,1678805580877 in 220 msec 2023-03-14 14:53:48,237 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-03-14 14:53:48,237 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=3ea13ff804537f3e856a240e0067a94c, ASSIGN in 382 msec 2023-03-14 14:53:48,238 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-14 14:53:48,238 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678805628238"}]},"ts":"1678805628238"} 2023-03-14 14:53:48,240 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLED in hbase:meta 2023-03-14 14:53:48,242 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_POST_OPERATION 2023-03-14 14:53:48,244 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles in 1.2400 sec 2023-03-14 14:53:49,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-03-14 14:53:49,119 INFO [Listener at localhost.localdomain/44261] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testScannerOnBulkLoadRefHFiles, procId: 27 completed 2023-03-14 14:53:49,133 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:53:49,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-03-14 14:53:49,135 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-03-14 14:53:49,136 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:53:49,136 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-03-14 14:53:49,136 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-03-14 14:53:49,136 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-14 14:53:49,137 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-14 14:53:49,138 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:53:49,138 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:49,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:53:49,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:53:49,138 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:49,139 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:53:49,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-14 14:53:49,139 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-14 14:53:49,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:53:49,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-14 14:53:49,140 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-03-14 14:53:49,140 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-03-14 14:53:49,140 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-03-14 14:53:49,140 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:53:49,141 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-03-14 14:53:49,141 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1678805627002.7eb84d1cb8ce303dd656f6348c25f0e3. 2023-03-14 14:53:49,141 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1678805627002.7eb84d1cb8ce303dd656f6348c25f0e3. started... 2023-03-14 14:53:49,151 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1678805627002.3ea13ff804537f3e856a240e0067a94c. 2023-03-14 14:53:49,151 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7eb84d1cb8ce303dd656f6348c25f0e3: 2023-03-14 14:53:49,151 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1678805627002.4fc16beb64e446f8e20e521dacdaf408. 2023-03-14 14:53:49,151 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1678805627002.4fc16beb64e446f8e20e521dacdaf408. started... 2023-03-14 14:53:49,151 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1678805627002.3ea13ff804537f3e856a240e0067a94c. started... 2023-03-14 14:53:49,151 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-14 14:53:49,152 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 3ea13ff804537f3e856a240e0067a94c: 2023-03-14 14:53:49,152 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1678805627002.3ea13ff804537f3e856a240e0067a94c. 2023-03-14 14:53:49,151 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 4fc16beb64e446f8e20e521dacdaf408 2/2 column families, dataSize=48 B heapSize=632 B 2023-03-14 14:53:49,151 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1678805627002.7eb84d1cb8ce303dd656f6348c25f0e3. 2023-03-14 14:53:49,152 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:53:49,152 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-14 14:53:49,152 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-14 14:53:49,574 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230314bcda0a99c01a4258beec30d4c3f0e816 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230314bcda0a99c01a4258beec30d4c3f0e816 2023-03-14 14:53:49,981 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=48, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testScannerOnBulkLoadRefHFiles/4fc16beb64e446f8e20e521dacdaf408/.tmp/family1/a8620920d17d4fc39d72d5eda9743a83 2023-03-14 14:53:49,994 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testScannerOnBulkLoadRefHFiles/4fc16beb64e446f8e20e521dacdaf408/.tmp/family1/a8620920d17d4fc39d72d5eda9743a83 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testScannerOnBulkLoadRefHFiles/4fc16beb64e446f8e20e521dacdaf408/family1/a8620920d17d4fc39d72d5eda9743a83 2023-03-14 14:53:50,001 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testScannerOnBulkLoadRefHFiles/4fc16beb64e446f8e20e521dacdaf408/family1/a8620920d17d4fc39d72d5eda9743a83, entries=1, sequenceid=5, filesize=4.9 K 2023-03-14 14:53:50,002 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~48 B/48, heapSize ~360 B/360, currentSize=0 B/0 for 4fc16beb64e446f8e20e521dacdaf408 in 851ms, sequenceid=5, compaction requested=false 2023-03-14 14:53:50,002 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testScannerOnBulkLoadRefHFiles' 2023-03-14 14:53:50,003 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 4fc16beb64e446f8e20e521dacdaf408: 2023-03-14 14:53:50,003 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1678805627002.4fc16beb64e446f8e20e521dacdaf408. 2023-03-14 14:53:50,003 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-14 14:53:50,003 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-14 14:53:50,003 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:50,003 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-03-14 14:53:50,003 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-03-14 14:53:50,005 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:50,005 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-14 14:53:50,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:50,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:50,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:50,005 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-14 14:53:50,005 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:53:50,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:50,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:50,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-14 14:53:50,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:50,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:50,007 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-03-14 14:53:50,007 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3d935ac[Count = 0] remaining members to acquire global barrier 2023-03-14 14:53:50,007 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-03-14 14:53:50,007 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-14 14:53:50,008 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-14 14:53:50,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-14 14:53:50,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-14 14:53:50,009 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-03-14 14:53:50,009 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-03-14 14:53:50,009 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:50,009 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:53:50,009 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:53:50,010 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:50,010 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-03-14 14:53:50,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:50,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:50,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:50,010 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:53:50,010 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-03-14 14:53:50,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:50,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:50,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-14 14:53:50,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:50,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:50,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-14 14:53:50,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:50,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:53:50,014 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-03-14 14:53:50,014 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-03-14 14:53:50,014 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:53:50,014 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:53:50,014 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-03-14 14:53:50,014 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:53:50,021 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-14 14:53:50,021 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-14 14:53:50,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-14 14:53:50,021 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:53:50,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-14 14:53:50,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-14 14:53:50,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:50,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:50,022 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:50,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:53:50,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:53:50,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:50,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-14 14:53:50,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-14 14:53:50,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:50,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-14 14:53:50,024 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:50,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:50,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:50,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-14 14:53:50,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:50,031 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:50,031 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:53:50,031 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-14 14:53:50,031 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-03-14 14:53:50,031 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:53:50,031 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:53:50,031 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:53:50,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:53:50,032 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-03-14 14:53:50,032 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:53:50,031 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:53:50,032 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-03-14 14:53:50,031 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-14 14:53:50,032 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:53:50,032 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:50,032 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-14 14:53:50,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:53:50,032 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-14 14:53:50,032 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-14 14:53:50,132 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:53:50,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:53:50,146 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:53:50,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(143): Procedure testScannerOnBulkLoadRefHFiles was in running list but was completed. Accepting new attempt. 2023-03-14 14:53:50,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-03-14 14:53:50,150 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-03-14 14:53:50,150 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:53:50,150 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-03-14 14:53:50,150 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-03-14 14:53:50,151 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-14 14:53:50,151 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-14 14:53:50,154 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:53:50,154 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:50,154 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:53:50,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:53:50,155 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:50,155 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:53:50,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-14 14:53:50,156 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-14 14:53:50,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:53:50,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-14 14:53:50,157 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-03-14 14:53:50,157 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testScannerOnBulkLoadRefHFiles is still present, removing 2023-03-14 14:53:50,158 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-03-14 14:53:50,158 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-03-14 14:53:50,158 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:53:50,158 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-03-14 14:53:50,158 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1678805627002.7eb84d1cb8ce303dd656f6348c25f0e3. 2023-03-14 14:53:50,158 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1678805627002.7eb84d1cb8ce303dd656f6348c25f0e3. started... 2023-03-14 14:53:50,158 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1678805627002.3ea13ff804537f3e856a240e0067a94c. 2023-03-14 14:53:50,158 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1678805627002.3ea13ff804537f3e856a240e0067a94c. started... 2023-03-14 14:53:50,158 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1678805627002.4fc16beb64e446f8e20e521dacdaf408. 2023-03-14 14:53:50,158 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 3ea13ff804537f3e856a240e0067a94c: 2023-03-14 14:53:50,158 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1678805627002.3ea13ff804537f3e856a240e0067a94c. 2023-03-14 14:53:50,158 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-14 14:53:50,159 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:53:50,158 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1678805627002.4fc16beb64e446f8e20e521dacdaf408. started... 2023-03-14 14:53:50,158 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7eb84d1cb8ce303dd656f6348c25f0e3: 2023-03-14 14:53:50,159 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1678805627002.7eb84d1cb8ce303dd656f6348c25f0e3. 2023-03-14 14:53:50,159 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 4fc16beb64e446f8e20e521dacdaf408 2/2 column families, dataSize=90 B heapSize=752 B 2023-03-14 14:53:50,159 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-14 14:53:50,159 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-14 14:53:50,579 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230314e76bea58defe4f7c93c2a85a1f0447c7 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230314e76bea58defe4f7c93c2a85a1f0447c7 2023-03-14 14:53:50,987 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=90, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testScannerOnBulkLoadRefHFiles/4fc16beb64e446f8e20e521dacdaf408/.tmp/family1/efaf150569c045f2a2f721c71d169bf9 2023-03-14 14:53:50,995 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testScannerOnBulkLoadRefHFiles/4fc16beb64e446f8e20e521dacdaf408/.tmp/family1/efaf150569c045f2a2f721c71d169bf9 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testScannerOnBulkLoadRefHFiles/4fc16beb64e446f8e20e521dacdaf408/family1/efaf150569c045f2a2f721c71d169bf9 2023-03-14 14:53:51,002 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testScannerOnBulkLoadRefHFiles/4fc16beb64e446f8e20e521dacdaf408/family1/efaf150569c045f2a2f721c71d169bf9, entries=2, sequenceid=9, filesize=5.0 K 2023-03-14 14:53:51,003 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~90 B/90, heapSize ~480 B/480, currentSize=0 B/0 for 4fc16beb64e446f8e20e521dacdaf408 in 844ms, sequenceid=9, compaction requested=false 2023-03-14 14:53:51,003 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 4fc16beb64e446f8e20e521dacdaf408: 2023-03-14 14:53:51,003 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1678805627002.4fc16beb64e446f8e20e521dacdaf408. 2023-03-14 14:53:51,004 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-14 14:53:51,004 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-14 14:53:51,004 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:51,004 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-03-14 14:53:51,004 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-03-14 14:53:51,005 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:51,005 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-14 14:53:51,005 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-14 14:53:51,005 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:53:51,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:51,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:51,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:51,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:51,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:51,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-14 14:53:51,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:51,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:51,013 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-03-14 14:53:51,013 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@47b27fbe[Count = 0] remaining members to acquire global barrier 2023-03-14 14:53:51,013 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-03-14 14:53:51,013 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-14 14:53:51,021 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-14 14:53:51,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-14 14:53:51,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-14 14:53:51,022 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:51,022 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-03-14 14:53:51,022 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:53:51,022 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-03-14 14:53:51,022 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:53:51,025 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-03-14 14:53:51,025 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:51,025 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:53:51,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:51,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:51,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:51,026 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-03-14 14:53:51,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:51,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:51,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-14 14:53:51,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:51,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:51,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-14 14:53:51,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:51,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:53:51,028 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-03-14 14:53:51,028 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-03-14 14:53:51,028 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:53:51,028 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:53:51,028 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-03-14 14:53:51,028 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:53:51,029 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-14 14:53:51,029 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-14 14:53:51,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-14 14:53:51,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:51,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:51,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-14 14:53:51,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-14 14:53:51,029 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:53:51,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:51,030 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:51,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:53:51,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:53:51,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-14 14:53:51,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-14 14:53:51,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:51,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-14 14:53:51,031 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:51,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:51,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:51,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-03-14 14:53:51,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:51,034 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:53:51,034 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:53:51,034 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:51,034 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:53:51,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:53:51,034 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:53:51,034 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-14 14:53:51,034 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-03-14 14:53:51,034 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:53:51,034 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-03-14 14:53:51,034 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:51,034 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-14 14:53:51,034 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-03-14 14:53:51,034 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-03-14 14:53:51,035 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-03-14 14:53:51,035 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-03-14 14:53:51,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:53:51,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:53:51,035 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:53:51,135 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:53:51,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:53:51,145 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=38031] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testScannerOnBulkLoadRefHFiles 2023-03-14 14:53:51,147 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-03-14 14:53:51,148 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-03-14 14:53:51,149 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] mob.MobUtils(833): start MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-14 14:53:51,149 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678806231149 2023-03-14 14:53:51,150 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-14 14:53:51,151 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testScannerOnBulkLoadRefHFiles' and column 'family1' 2023-03-14 14:53:51,151 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-03-14 14:53:51,151 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] zookeeper.ReadOnlyZKClient(139): Connect 0x7d43bd40 to 127.0.0.1:50211 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-14 14:53:51,158 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7e0124f8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-14 14:53:51,159 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230314 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-03-14 14:53:51,197 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023031439507d27d80842a695c69fb2596f19bd to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c2023031439507d27d80842a695c69fb2596f19bd 2023-03-14 14:53:51,198 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230314 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-03-14 14:53:51,217 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-14 14:53:51,218 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:51956, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-14 14:53:51,227 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-14 14:53:51,230 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:56174, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-14 14:53:51,244 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230314/family1/5c926182cdf2441495a0c42963435a23 first=Optional[k0] last=Optional[k1] 2023-03-14 14:53:51,244 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testScannerOnBulkLoadRefHFiles,2,1678805627002.4fc16beb64e446f8e20e521dacdaf408., hostname=jenkins-hbase20.apache.org,41317,1678805580877, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230314/family1/5c926182cdf2441495a0c42963435a23}] 2023-03-14 14:53:51,253 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230314/family1/5c926182cdf2441495a0c42963435a23 for inclusion in 4fc16beb64e446f8e20e521dacdaf408/family1 2023-03-14 14:53:51,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(775): HFile bounds: first=k0 last=k1 2023-03-14 14:53:51,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(777): Region bounds: first=2 last= 2023-03-14 14:53:51,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HRegion(2446): Flush status journal for 4fc16beb64e446f8e20e521dacdaf408: 2023-03-14 14:53:51,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230314/family1/5c926182cdf2441495a0c42963435a23 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testScannerOnBulkLoadRefHFiles__n0lh3607lspf6mqv3n7jovq572abkvf01fmu35re4nml30i3c2io4qienakselfe/family1/5c926182cdf2441495a0c42963435a23 2023-03-14 14:53:51,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testScannerOnBulkLoadRefHFiles__n0lh3607lspf6mqv3n7jovq572abkvf01fmu35re4nml30i3c2io4qienakselfe/family1/5c926182cdf2441495a0c42963435a23 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testScannerOnBulkLoadRefHFiles/4fc16beb64e446f8e20e521dacdaf408/family1/bb17c9b9140646a690ed3ff8cc0675a3_SeqId_12_ 2023-03-14 14:53:51,261 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testScannerOnBulkLoadRefHFiles__n0lh3607lspf6mqv3n7jovq572abkvf01fmu35re4nml30i3c2io4qienakselfe/family1/5c926182cdf2441495a0c42963435a23 into 4fc16beb64e446f8e20e521dacdaf408/family1 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testScannerOnBulkLoadRefHFiles/4fc16beb64e446f8e20e521dacdaf408/family1/bb17c9b9140646a690ed3ff8cc0675a3_SeqId_12_ - updating store file list. 2023-03-14 14:53:51,270 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testScannerOnBulkLoadRefHFiles/4fc16beb64e446f8e20e521dacdaf408/family1/bb17c9b9140646a690ed3ff8cc0675a3_SeqId_12_ into 4fc16beb64e446f8e20e521dacdaf408/family1 2023-03-14 14:53:51,271 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testScannerOnBulkLoadRefHFiles__n0lh3607lspf6mqv3n7jovq572abkvf01fmu35re4nml30i3c2io4qienakselfe/family1/5c926182cdf2441495a0c42963435a23 into 4fc16beb64e446f8e20e521dacdaf408/family1 (new location: hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testScannerOnBulkLoadRefHFiles/4fc16beb64e446f8e20e521dacdaf408/family1/bb17c9b9140646a690ed3ff8cc0675a3_SeqId_12_) 2023-03-14 14:53:51,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testScannerOnBulkLoadRefHFiles__n0lh3607lspf6mqv3n7jovq572abkvf01fmu35re4nml30i3c2io4qienakselfe/family1/5c926182cdf2441495a0c42963435a23 2023-03-14 14:53:51,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-14 14:53:51,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 15445 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-14 14:53:51,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(1912): 4fc16beb64e446f8e20e521dacdaf408/family1 is initiating minor compaction (all files) 2023-03-14 14:53:51,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@5c5282c0; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-14 14:53:51,273 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 4fc16beb64e446f8e20e521dacdaf408/family1 in testScannerOnBulkLoadRefHFiles,2,1678805627002.4fc16beb64e446f8e20e521dacdaf408. 2023-03-14 14:53:51,273 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testScannerOnBulkLoadRefHFiles/4fc16beb64e446f8e20e521dacdaf408/family1/a8620920d17d4fc39d72d5eda9743a83, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testScannerOnBulkLoadRefHFiles/4fc16beb64e446f8e20e521dacdaf408/family1/efaf150569c045f2a2f721c71d169bf9, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testScannerOnBulkLoadRefHFiles/4fc16beb64e446f8e20e521dacdaf408/family1/bb17c9b9140646a690ed3ff8cc0675a3_SeqId_12_] into tmpdir=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testScannerOnBulkLoadRefHFiles/4fc16beb64e446f8e20e521dacdaf408/.tmp, totalSize=15.1 K 2023-03-14 14:53:51,274 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting a8620920d17d4fc39d72d5eda9743a83, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678805629119 2023-03-14 14:53:51,274 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting efaf150569c045f2a2f721c71d169bf9, keycount=2, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678805629119 2023-03-14 14:53:51,275 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting bb17c9b9140646a690ed3ff8cc0675a3_SeqId_12_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678805629119 2023-03-14 14:53:51,275 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230314 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-03-14 14:53:51,277 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 14:53:51,279 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230314bcda0a99c01a4258beec30d4c3f0e816 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230314bcda0a99c01a4258beec30d4c3f0e816 2023-03-14 14:53:51,280 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230314e76bea58defe4f7c93c2a85a1f0447c7 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230314e76bea58defe4f7c93c2a85a1f0447c7 2023-03-14 14:53:51,280 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testScannerOnBulkLoadRefHFiles 2 expired mob files are deleted 2023-03-14 14:53:51,280 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230314' 2023-03-14 14:53:51,281 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230314 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-03-14 14:53:51,281 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-03-14 14:53:51,281 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] mob.MobUtils(840): end MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-14 14:53:51,282 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-03-14 14:53:51,284 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE in 137 msec 2023-03-14 14:53:51,287 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] throttle.PressureAwareThroughputController(145): 4fc16beb64e446f8e20e521dacdaf408#family1#compaction#38 average throughput is 0.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-14 14:53:51,321 INFO [Listener at localhost.localdomain/44261] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=251 (was 254), OpenFileDescriptor=607 (was 596) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=260 (was 282), ProcessCount=170 (was 172), AvailableMemoryMB=12538 (was 12535) - AvailableMemoryMB LEAK? - 2023-03-14 14:53:51,332 INFO [Listener at localhost.localdomain/44261] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=251, OpenFileDescriptor=607, MaxFileDescriptor=60000, SystemLoadAverage=260, ProcessCount=170, AvailableMemoryMB=12537 2023-03-14 14:53:51,334 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-03-14 14:53:51,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:51,337 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-03-14 14:53:51,337 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyPolicy" procId is: 35 2023-03-14 14:53:51,338 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-14 14:53:51,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-03-14 14:53:51,339 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df 2023-03-14 14:53:51,340 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df empty. 2023-03-14 14:53:51,340 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df 2023-03-14 14:53:51,340 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyPolicy regions 2023-03-14 14:53:51,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-03-14 14:53:51,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-03-14 14:53:51,752 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-03-14 14:53:51,754 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 3b6ac335f3eded6c9d62899b5ba0c2df, NAME => 'testMajorCompactionWithWeeklyPolicy,,1678805631334.3b6ac335f3eded6c9d62899b5ba0c2df.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp 2023-03-14 14:53:51,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-03-14 14:53:52,165 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1678805631334.3b6ac335f3eded6c9d62899b5ba0c2df.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 14:53:52,166 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing 3b6ac335f3eded6c9d62899b5ba0c2df, disabling compactions & flushes 2023-03-14 14:53:52,166 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1678805631334.3b6ac335f3eded6c9d62899b5ba0c2df. 2023-03-14 14:53:52,166 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1678805631334.3b6ac335f3eded6c9d62899b5ba0c2df. 2023-03-14 14:53:52,166 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1678805631334.3b6ac335f3eded6c9d62899b5ba0c2df. after waiting 0 ms 2023-03-14 14:53:52,166 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1678805631334.3b6ac335f3eded6c9d62899b5ba0c2df. 2023-03-14 14:53:52,166 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1678805631334.3b6ac335f3eded6c9d62899b5ba0c2df. 2023-03-14 14:53:52,166 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 3b6ac335f3eded6c9d62899b5ba0c2df: 2023-03-14 14:53:52,172 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-03-14 14:53:52,174 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyPolicy,,1678805631334.3b6ac335f3eded6c9d62899b5ba0c2df.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1678805632174"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678805632174"}]},"ts":"1678805632174"} 2023-03-14 14:53:52,177 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-14 14:53:52,178 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-14 14:53:52,178 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678805632178"}]},"ts":"1678805632178"} 2023-03-14 14:53:52,179 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-03-14 14:53:52,181 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=3b6ac335f3eded6c9d62899b5ba0c2df, ASSIGN}] 2023-03-14 14:53:52,182 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=3b6ac335f3eded6c9d62899b5ba0c2df, ASSIGN 2023-03-14 14:53:52,183 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=3b6ac335f3eded6c9d62899b5ba0c2df, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,41317,1678805580877; forceNewPlan=false, retain=false 2023-03-14 14:53:52,334 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=3b6ac335f3eded6c9d62899b5ba0c2df, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:52,335 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyPolicy,,1678805631334.3b6ac335f3eded6c9d62899b5ba0c2df.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1678805632334"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1678805632334"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678805632334"}]},"ts":"1678805632334"} 2023-03-14 14:53:52,338 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; OpenRegionProcedure 3b6ac335f3eded6c9d62899b5ba0c2df, server=jenkins-hbase20.apache.org,41317,1678805580877}] 2023-03-14 14:53:52,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-03-14 14:53:52,497 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyPolicy,,1678805631334.3b6ac335f3eded6c9d62899b5ba0c2df. 2023-03-14 14:53:52,498 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3b6ac335f3eded6c9d62899b5ba0c2df, NAME => 'testMajorCompactionWithWeeklyPolicy,,1678805631334.3b6ac335f3eded6c9d62899b5ba0c2df.', STARTKEY => '', ENDKEY => ''} 2023-03-14 14:53:52,498 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyPolicy 3b6ac335f3eded6c9d62899b5ba0c2df 2023-03-14 14:53:52,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1678805631334.3b6ac335f3eded6c9d62899b5ba0c2df.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 14:53:52,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 3b6ac335f3eded6c9d62899b5ba0c2df 2023-03-14 14:53:52,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 3b6ac335f3eded6c9d62899b5ba0c2df 2023-03-14 14:53:52,502 INFO [StoreOpener-3b6ac335f3eded6c9d62899b5ba0c2df-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 3b6ac335f3eded6c9d62899b5ba0c2df 2023-03-14 14:53:52,504 DEBUG [StoreOpener-3b6ac335f3eded6c9d62899b5ba0c2df-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1 2023-03-14 14:53:52,505 DEBUG [StoreOpener-3b6ac335f3eded6c9d62899b5ba0c2df-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1 2023-03-14 14:53:52,505 INFO [StoreOpener-3b6ac335f3eded6c9d62899b5ba0c2df-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3b6ac335f3eded6c9d62899b5ba0c2df columnFamilyName family1 2023-03-14 14:53:52,508 INFO [StoreOpener-3b6ac335f3eded6c9d62899b5ba0c2df-1] regionserver.HStore(310): Store=3b6ac335f3eded6c9d62899b5ba0c2df/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 14:53:52,510 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df 2023-03-14 14:53:52,510 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df 2023-03-14 14:53:52,514 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 3b6ac335f3eded6c9d62899b5ba0c2df 2023-03-14 14:53:52,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-14 14:53:52,516 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testScannerOnBulkLoadRefHFiles/4fc16beb64e446f8e20e521dacdaf408/.tmp/family1/c7321ed92b9041d38df16d68aa521b6e as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testScannerOnBulkLoadRefHFiles/4fc16beb64e446f8e20e521dacdaf408/family1/c7321ed92b9041d38df16d68aa521b6e 2023-03-14 14:53:52,516 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 3b6ac335f3eded6c9d62899b5ba0c2df; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59727413, jitterRate=-0.10999219119548798}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-14 14:53:52,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 3b6ac335f3eded6c9d62899b5ba0c2df: 2023-03-14 14:53:52,517 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyPolicy,,1678805631334.3b6ac335f3eded6c9d62899b5ba0c2df., pid=37, masterSystemTime=1678805632492 2023-03-14 14:53:52,519 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyPolicy,,1678805631334.3b6ac335f3eded6c9d62899b5ba0c2df. 2023-03-14 14:53:52,519 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyPolicy,,1678805631334.3b6ac335f3eded6c9d62899b5ba0c2df. 2023-03-14 14:53:52,519 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=3b6ac335f3eded6c9d62899b5ba0c2df, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:52,519 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyPolicy,,1678805631334.3b6ac335f3eded6c9d62899b5ba0c2df.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1678805632519"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1678805632519"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678805632519"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678805632519"}]},"ts":"1678805632519"} 2023-03-14 14:53:52,522 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 4fc16beb64e446f8e20e521dacdaf408/family1 of 4fc16beb64e446f8e20e521dacdaf408 into c7321ed92b9041d38df16d68aa521b6e(size=5.1 K), total size for store is 5.1 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-14 14:53:52,522 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 4fc16beb64e446f8e20e521dacdaf408: 2023-03-14 14:53:52,522 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testScannerOnBulkLoadRefHFiles,2,1678805627002.4fc16beb64e446f8e20e521dacdaf408., storeName=family1, fileCount=3, fileSize=15.1 K (4.9 K, 5.0 K, 5.2 K), priority=2, time=1678805631273; duration=1sec 2023-03-14 14:53:52,522 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-14 14:53:52,523 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-03-14 14:53:52,523 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; OpenRegionProcedure 3b6ac335f3eded6c9d62899b5ba0c2df, server=jenkins-hbase20.apache.org,41317,1678805580877 in 183 msec 2023-03-14 14:53:52,525 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=36, resume processing ppid=35 2023-03-14 14:53:52,525 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=3b6ac335f3eded6c9d62899b5ba0c2df, ASSIGN in 342 msec 2023-03-14 14:53:52,526 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-14 14:53:52,526 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678805632526"}]},"ts":"1678805632526"} 2023-03-14 14:53:52,527 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-03-14 14:53:52,529 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-03-14 14:53:52,530 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy in 1.1950 sec 2023-03-14 14:53:52,623 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testScannerOnBulkLoadRefHFiles/4fc16beb64e446f8e20e521dacdaf408/family1/a8620920d17d4fc39d72d5eda9743a83, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testScannerOnBulkLoadRefHFiles/4fc16beb64e446f8e20e521dacdaf408/family1/efaf150569c045f2a2f721c71d169bf9, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testScannerOnBulkLoadRefHFiles/4fc16beb64e446f8e20e521dacdaf408/family1/bb17c9b9140646a690ed3ff8cc0675a3_SeqId_12_] to archive 2023-03-14 14:53:52,624 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 14:53:52,627 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testScannerOnBulkLoadRefHFiles/4fc16beb64e446f8e20e521dacdaf408/family1/a8620920d17d4fc39d72d5eda9743a83 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testScannerOnBulkLoadRefHFiles/4fc16beb64e446f8e20e521dacdaf408/family1/a8620920d17d4fc39d72d5eda9743a83 2023-03-14 14:53:52,629 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testScannerOnBulkLoadRefHFiles/4fc16beb64e446f8e20e521dacdaf408/family1/efaf150569c045f2a2f721c71d169bf9 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testScannerOnBulkLoadRefHFiles/4fc16beb64e446f8e20e521dacdaf408/family1/efaf150569c045f2a2f721c71d169bf9 2023-03-14 14:53:52,632 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testScannerOnBulkLoadRefHFiles/4fc16beb64e446f8e20e521dacdaf408/family1/bb17c9b9140646a690ed3ff8cc0675a3_SeqId_12_ to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testScannerOnBulkLoadRefHFiles/4fc16beb64e446f8e20e521dacdaf408/family1/bb17c9b9140646a690ed3ff8cc0675a3_SeqId_12_ 2023-03-14 14:53:53,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-03-14 14:53:53,447 INFO [Listener at localhost.localdomain/44261] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyPolicy, procId: 35 completed 2023-03-14 14:53:53,474 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:53:53,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:53,475 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-14 14:53:53,475 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:53:53,475 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-14 14:53:53,475 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-14 14:53:53,476 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:53,476 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:53,477 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:53:53,477 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:53,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:53:53,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:53:53,477 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:53,477 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:53:53,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:53,477 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:53,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:53:53,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:53,478 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:53,478 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:53,478 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-14 14:53:53,478 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:53:53,478 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-14 14:53:53,478 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 14:53:53,478 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:53:53,478 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1678805631334.3b6ac335f3eded6c9d62899b5ba0c2df. 2023-03-14 14:53:53,478 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1678805631334.3b6ac335f3eded6c9d62899b5ba0c2df. started... 2023-03-14 14:53:53,479 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 3b6ac335f3eded6c9d62899b5ba0c2df 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-14 14:53:53,706 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-14 14:53:53,900 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511305599adb3ce5e4812aebc7faa571577b8 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511305599adb3ce5e4812aebc7faa571577b8 2023-03-14 14:53:54,306 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/.tmp/family1/1a9d89da9d804b878895c3f5f7ddcb74 2023-03-14 14:53:54,318 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/.tmp/family1/1a9d89da9d804b878895c3f5f7ddcb74 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/1a9d89da9d804b878895c3f5f7ddcb74 2023-03-14 14:53:54,323 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/1a9d89da9d804b878895c3f5f7ddcb74, entries=1000, sequenceid=5, filesize=165.1 K 2023-03-14 14:53:54,323 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 3b6ac335f3eded6c9d62899b5ba0c2df in 844ms, sequenceid=5, compaction requested=false 2023-03-14 14:53:54,323 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyPolicy' 2023-03-14 14:53:54,324 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 3b6ac335f3eded6c9d62899b5ba0c2df: 2023-03-14 14:53:54,324 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1678805631334.3b6ac335f3eded6c9d62899b5ba0c2df. 2023-03-14 14:53:54,324 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 14:53:54,324 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 14:53:54,324 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:54,324 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-14 14:53:54,324 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-14 14:53:54,325 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:54,325 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:54,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:54,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:54,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:54,326 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:54,326 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:53:54,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:54,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:54,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:54,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:54,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:54,327 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-14 14:53:54,327 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@bce46a9[Count = 0] remaining members to acquire global barrier 2023-03-14 14:53:54,327 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-14 14:53:54,327 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:54,328 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:54,328 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:54,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:54,328 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-14 14:53:54,328 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-14 14:53:54,328 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:53:54,328 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:54,328 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:53:54,329 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-14 14:53:54,329 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:54,329 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:53:54,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:54,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:54,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:54,329 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-14 14:53:54,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:54,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:54,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:54,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:54,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:54,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:54,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:54,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:53:54,332 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-14 14:53:54,332 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-14 14:53:54,332 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:53:54,332 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:53:54,332 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:54,332 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:53:54,333 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:54,333 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:53:54,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:54,333 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:54,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:54,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:54,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:54,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:54,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:53:54,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:53:54,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:54,334 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:54,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:54,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:54,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:54,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:54,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:54,335 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:54,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:54,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:54,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:54,337 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:54,337 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:54,337 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:53:54,337 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:54,337 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:53:54,337 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:54,337 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-14 14:53:54,337 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:53:54,337 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:53:54,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:53:54,337 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:53:54,337 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-14 14:53:54,337 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:53:54,337 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:54,337 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:53:54,337 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:54,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:53:54,338 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:54,438 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:53:54,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:53:54,450 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:53:54,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-14 14:53:54,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:54,454 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-14 14:53:54,454 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:53:54,454 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-14 14:53:54,454 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-14 14:53:54,455 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:54,455 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:54,457 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:54,457 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:53:54,457 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:53:54,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:53:54,457 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:54,458 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:53:54,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:54,459 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:54,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:53:54,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:54,460 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:54,460 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-14 14:53:54,460 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:54,461 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-14 14:53:54,461 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:53:54,461 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-14 14:53:54,461 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 14:53:54,461 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:53:54,461 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1678805631334.3b6ac335f3eded6c9d62899b5ba0c2df. 2023-03-14 14:53:54,461 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1678805631334.3b6ac335f3eded6c9d62899b5ba0c2df. started... 2023-03-14 14:53:54,461 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 3b6ac335f3eded6c9d62899b5ba0c2df 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-14 14:53:54,887 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511284b4fbba62880495e95d23cb5eb1ea2c4 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511284b4fbba62880495e95d23cb5eb1ea2c4 2023-03-14 14:53:55,296 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/.tmp/family1/8bb4771998cb4208aae433ec671c1c69 2023-03-14 14:53:55,308 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/.tmp/family1/8bb4771998cb4208aae433ec671c1c69 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/8bb4771998cb4208aae433ec671c1c69 2023-03-14 14:53:55,315 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/8bb4771998cb4208aae433ec671c1c69, entries=1, sequenceid=9, filesize=5.0 K 2023-03-14 14:53:55,316 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 3b6ac335f3eded6c9d62899b5ba0c2df in 855ms, sequenceid=9, compaction requested=false 2023-03-14 14:53:55,317 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 3b6ac335f3eded6c9d62899b5ba0c2df: 2023-03-14 14:53:55,317 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1678805631334.3b6ac335f3eded6c9d62899b5ba0c2df. 2023-03-14 14:53:55,317 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 14:53:55,317 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 14:53:55,317 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:55,317 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-14 14:53:55,317 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-14 14:53:55,318 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:55,318 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:55,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:55,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:55,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:55,319 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:55,319 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:53:55,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:55,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:55,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:55,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:55,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:55,321 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-14 14:53:55,321 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7bf5cde8[Count = 0] remaining members to acquire global barrier 2023-03-14 14:53:55,321 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-14 14:53:55,321 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:55,322 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:55,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:55,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:55,322 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:55,322 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:53:55,322 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-14 14:53:55,323 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-14 14:53:55,323 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:53:55,324 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:55,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:55,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:55,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:55,324 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-14 14:53:55,324 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:53:55,324 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-14 14:53:55,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:55,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:55,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:55,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:55,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:55,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:55,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:55,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:53:55,327 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-14 14:53:55,327 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-14 14:53:55,327 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:53:55,327 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:53:55,327 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:55,327 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:53:55,329 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:55,329 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:55,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:55,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:55,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:55,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:55,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:55,329 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:53:55,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:55,330 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:53:55,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:53:55,330 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:55,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:55,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:55,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:55,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:55,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:55,331 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:55,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:55,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:55,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:55,333 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:55,333 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:55,333 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:53:55,333 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:55,333 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-14 14:53:55,333 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:53:55,333 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:55,333 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:53:55,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:53:55,333 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:53:55,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:53:55,333 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:55,333 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-14 14:53:55,333 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:55,333 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:53:55,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:53:55,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:53:55,333 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:55,434 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:53:55,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:53:55,438 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:53:55,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-14 14:53:55,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:55,440 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-14 14:53:55,440 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:53:55,440 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-14 14:53:55,440 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-14 14:53:55,440 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:55,440 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:55,441 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:53:55,441 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:55,441 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:53:55,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:53:55,442 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:55,442 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:53:55,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:55,442 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:55,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:53:55,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:55,442 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:55,442 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-14 14:53:55,442 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:55,442 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-14 14:53:55,442 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:53:55,442 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-14 14:53:55,443 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 14:53:55,443 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:53:55,443 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1678805631334.3b6ac335f3eded6c9d62899b5ba0c2df. 2023-03-14 14:53:55,443 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1678805631334.3b6ac335f3eded6c9d62899b5ba0c2df. started... 2023-03-14 14:53:55,443 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 3b6ac335f3eded6c9d62899b5ba0c2df 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 14:53:55,862 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201f68063278f1643e693eed358c4a6e2ab to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201f68063278f1643e693eed358c4a6e2ab 2023-03-14 14:53:56,270 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/.tmp/family1/c108984834db49678581f4aacb859a78 2023-03-14 14:53:56,282 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/.tmp/family1/c108984834db49678581f4aacb859a78 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/c108984834db49678581f4aacb859a78 2023-03-14 14:53:56,289 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/c108984834db49678581f4aacb859a78, entries=1, sequenceid=13, filesize=4.9 K 2023-03-14 14:53:56,290 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 3b6ac335f3eded6c9d62899b5ba0c2df in 847ms, sequenceid=13, compaction requested=true 2023-03-14 14:53:56,291 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 3b6ac335f3eded6c9d62899b5ba0c2df: 2023-03-14 14:53:56,291 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1678805631334.3b6ac335f3eded6c9d62899b5ba0c2df. 2023-03-14 14:53:56,291 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 14:53:56,291 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 14:53:56,291 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:56,291 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-14 14:53:56,291 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-14 14:53:56,292 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:56,292 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:56,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:56,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:56,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:56,292 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:56,292 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:53:56,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:56,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:56,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:56,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:56,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:56,294 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-14 14:53:56,294 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@314be36f[Count = 0] remaining members to acquire global barrier 2023-03-14 14:53:56,294 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-14 14:53:56,294 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:56,294 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:56,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:56,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:56,294 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-14 14:53:56,294 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-14 14:53:56,295 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:53:56,295 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:56,295 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:53:56,295 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:56,295 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-14 14:53:56,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:56,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:56,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:56,296 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:53:56,296 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-14 14:53:56,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:56,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:56,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:56,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:56,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:56,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:56,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:56,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:53:56,298 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-14 14:53:56,298 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-14 14:53:56,298 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:53:56,298 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:53:56,298 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:56,298 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:53:56,299 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:56,299 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:56,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:56,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:56,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:56,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:56,299 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:53:56,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:56,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:56,299 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:56,300 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:53:56,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:56,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:53:56,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:56,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:56,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:56,300 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:56,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:56,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:56,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:56,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:56,301 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:56,301 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:56,301 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:53:56,301 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:56,301 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-14 14:53:56,302 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:53:56,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:53:56,301 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:53:56,301 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:53:56,302 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-14 14:53:56,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:53:56,302 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:56,302 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-14 14:53:56,302 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:56,302 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:53:56,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:53:56,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:53:56,302 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:56,302 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:56,402 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:53:56,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:53:56,411 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:53:56,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-14 14:53:56,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:56,415 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-14 14:53:56,415 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:53:56,415 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-14 14:53:56,415 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-14 14:53:56,416 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:56,416 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:56,418 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:53:56,418 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:56,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:53:56,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:53:56,418 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:56,418 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:53:56,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:56,418 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:56,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:53:56,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:56,419 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:56,419 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-14 14:53:56,419 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:56,419 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-14 14:53:56,419 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:53:56,419 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-14 14:53:56,419 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 14:53:56,419 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:53:56,419 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1678805631334.3b6ac335f3eded6c9d62899b5ba0c2df. 2023-03-14 14:53:56,419 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1678805631334.3b6ac335f3eded6c9d62899b5ba0c2df. started... 2023-03-14 14:53:56,419 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 3b6ac335f3eded6c9d62899b5ba0c2df 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 14:53:56,840 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205c09e7477891944c09f4cb402c61e1a86 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205c09e7477891944c09f4cb402c61e1a86 2023-03-14 14:53:57,248 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/.tmp/family1/faff6d7680cd4c518e4597cb6c16fbcb 2023-03-14 14:53:57,261 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/.tmp/family1/faff6d7680cd4c518e4597cb6c16fbcb as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/faff6d7680cd4c518e4597cb6c16fbcb 2023-03-14 14:53:57,269 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/faff6d7680cd4c518e4597cb6c16fbcb, entries=1, sequenceid=17, filesize=4.9 K 2023-03-14 14:53:57,271 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 3b6ac335f3eded6c9d62899b5ba0c2df in 852ms, sequenceid=17, compaction requested=true 2023-03-14 14:53:57,271 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 3b6ac335f3eded6c9d62899b5ba0c2df: 2023-03-14 14:53:57,271 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1678805631334.3b6ac335f3eded6c9d62899b5ba0c2df. 2023-03-14 14:53:57,271 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 14:53:57,271 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 14:53:57,271 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:57,271 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-14 14:53:57,271 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-14 14:53:57,272 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:57,272 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:57,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:57,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:57,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:57,273 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:57,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:57,273 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:53:57,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:57,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:57,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:57,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:57,275 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-14 14:53:57,275 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@65d03577[Count = 0] remaining members to acquire global barrier 2023-03-14 14:53:57,275 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-14 14:53:57,275 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:57,276 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:57,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:57,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:57,276 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-14 14:53:57,276 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-14 14:53:57,276 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:53:57,276 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:57,276 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:53:57,277 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:57,277 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-14 14:53:57,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:57,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:57,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:57,277 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:53:57,277 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-14 14:53:57,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:57,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:57,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:57,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:57,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:57,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:57,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:57,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:53:57,279 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-14 14:53:57,279 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-14 14:53:57,279 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:53:57,279 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:53:57,279 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:57,279 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:53:57,280 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:57,280 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:57,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:57,280 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:53:57,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:57,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:57,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:57,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:57,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:53:57,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:53:57,280 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:57,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:57,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:57,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:57,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:57,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:57,281 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:57,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:57,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:57,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:57,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:57,283 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:57,283 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:57,283 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:53:57,283 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:57,283 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:53:57,283 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-14 14:53:57,283 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:53:57,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:53:57,283 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:53:57,283 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:57,283 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:57,283 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:57,283 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-14 14:53:57,283 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:53:57,283 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-14 14:53:57,283 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:57,283 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:53:57,283 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:53:57,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:53:57,383 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:53:57,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:53:57,389 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:53:57,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-14 14:53:57,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:57,391 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-14 14:53:57,391 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:53:57,391 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-14 14:53:57,391 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-14 14:53:57,392 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:57,392 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:57,394 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:53:57,394 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:57,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:53:57,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:53:57,395 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:57,395 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:53:57,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:57,395 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:57,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:53:57,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:57,396 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:57,396 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-14 14:53:57,396 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:57,396 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-14 14:53:57,396 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:53:57,396 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-14 14:53:57,397 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 14:53:57,397 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:53:57,397 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1678805631334.3b6ac335f3eded6c9d62899b5ba0c2df. 2023-03-14 14:53:57,397 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1678805631334.3b6ac335f3eded6c9d62899b5ba0c2df. started... 2023-03-14 14:53:57,397 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 3b6ac335f3eded6c9d62899b5ba0c2df 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 14:53:57,825 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228a3222bad9fef4364a011143d938d238b to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228a3222bad9fef4364a011143d938d238b 2023-03-14 14:53:58,232 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/.tmp/family1/6aaa9d38306d4b53b8e2b65297617621 2023-03-14 14:53:58,245 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/.tmp/family1/6aaa9d38306d4b53b8e2b65297617621 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/6aaa9d38306d4b53b8e2b65297617621 2023-03-14 14:53:58,253 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/6aaa9d38306d4b53b8e2b65297617621, entries=1, sequenceid=21, filesize=4.9 K 2023-03-14 14:53:58,254 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 3b6ac335f3eded6c9d62899b5ba0c2df in 857ms, sequenceid=21, compaction requested=true 2023-03-14 14:53:58,254 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 3b6ac335f3eded6c9d62899b5ba0c2df: 2023-03-14 14:53:58,254 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1678805631334.3b6ac335f3eded6c9d62899b5ba0c2df. 2023-03-14 14:53:58,254 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 14:53:58,254 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 14:53:58,254 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:58,254 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-14 14:53:58,255 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-14 14:53:58,256 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:58,256 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:58,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:58,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:58,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:58,257 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:58,257 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:53:58,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:58,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:58,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:58,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:58,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:58,259 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-14 14:53:58,259 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1c52cc6a[Count = 0] remaining members to acquire global barrier 2023-03-14 14:53:58,259 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-14 14:53:58,259 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:58,260 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:58,260 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:58,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:58,260 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-14 14:53:58,260 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-14 14:53:58,260 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:53:58,260 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:58,260 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:53:58,261 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:58,261 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-14 14:53:58,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:58,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:58,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:58,261 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:53:58,261 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-14 14:53:58,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:58,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:58,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:58,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:58,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:58,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:58,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:58,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:53:58,264 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-14 14:53:58,264 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-14 14:53:58,264 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:53:58,264 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:53:58,264 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:58,265 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:53:58,266 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:58,266 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:58,266 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:58,266 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:53:58,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:58,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:58,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:58,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:58,267 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:58,267 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:53:58,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:53:58,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:58,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:58,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:58,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:58,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:58,268 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:58,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:58,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:58,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:58,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:58,271 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:58,271 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:53:58,271 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:58,271 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:53:58,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:53:58,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:53:58,271 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:53:58,271 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-14 14:53:58,271 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-14 14:53:58,272 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:53:58,271 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:58,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:53:58,272 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:58,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:53:58,272 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-14 14:53:58,272 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:58,272 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:53:58,272 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:58,272 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:58,372 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:53:58,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:53:58,380 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:53:58,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-14 14:53:58,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:58,383 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-14 14:53:58,383 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:53:58,383 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-14 14:53:58,383 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-14 14:53:58,383 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:58,383 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:58,384 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:53:58,384 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:58,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:53:58,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:53:58,385 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:58,385 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:53:58,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:58,386 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:58,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:53:58,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:58,386 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:58,386 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-14 14:53:58,387 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:58,387 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-14 14:53:58,387 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:53:58,387 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-14 14:53:58,387 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 14:53:58,387 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:53:58,387 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1678805631334.3b6ac335f3eded6c9d62899b5ba0c2df. 2023-03-14 14:53:58,387 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1678805631334.3b6ac335f3eded6c9d62899b5ba0c2df. started... 2023-03-14 14:53:58,387 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 3b6ac335f3eded6c9d62899b5ba0c2df 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 14:53:58,801 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512312065cce0e80546fc90aabd49a22cf7a0 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512312065cce0e80546fc90aabd49a22cf7a0 2023-03-14 14:53:59,207 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/.tmp/family1/50f230331bf94e50a73f19ee69d9de87 2023-03-14 14:53:59,217 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/.tmp/family1/50f230331bf94e50a73f19ee69d9de87 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/50f230331bf94e50a73f19ee69d9de87 2023-03-14 14:53:59,223 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/50f230331bf94e50a73f19ee69d9de87, entries=1, sequenceid=25, filesize=4.9 K 2023-03-14 14:53:59,224 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 3b6ac335f3eded6c9d62899b5ba0c2df in 837ms, sequenceid=25, compaction requested=true 2023-03-14 14:53:59,224 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 3b6ac335f3eded6c9d62899b5ba0c2df: 2023-03-14 14:53:59,224 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1678805631334.3b6ac335f3eded6c9d62899b5ba0c2df. 2023-03-14 14:53:59,224 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 14:53:59,224 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 14:53:59,224 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:59,225 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-14 14:53:59,225 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-14 14:53:59,226 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:59,226 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:59,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:59,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:59,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:59,227 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:59,227 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:53:59,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:59,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:59,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:59,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:59,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:59,229 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-14 14:53:59,229 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@491dd885[Count = 0] remaining members to acquire global barrier 2023-03-14 14:53:59,229 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-14 14:53:59,229 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:59,233 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:59,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:59,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:59,233 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-14 14:53:59,234 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-14 14:53:59,234 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:53:59,234 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:59,234 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:53:59,235 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-14 14:53:59,235 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:59,235 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:53:59,235 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-14 14:53:59,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:59,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:59,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:59,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:59,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:59,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:59,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:59,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:59,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:59,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:59,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:53:59,239 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-14 14:53:59,239 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-14 14:53:59,239 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:53:59,239 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:53:59,239 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:59,239 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:53:59,241 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:59,241 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:59,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:59,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:59,241 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:53:59,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:59,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:53:59,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:53:59,242 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:53:59,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:53:59,242 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:59,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:53:59,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:59,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:59,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:53:59,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:59,244 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:59,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:59,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:53:59,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:59,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:59,254 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:53:59,254 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:59,255 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:59,255 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:59,255 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-14 14:53:59,255 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:53:59,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:53:59,255 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:53:59,255 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:59,255 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-14 14:53:59,256 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:53:59,255 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:53:59,255 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:59,256 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:53:59,256 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-14 14:53:59,256 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:59,256 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:53:59,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:53:59,256 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:59,357 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:53:59,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:53:59,369 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:53:59,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-14 14:53:59,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:59,372 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-14 14:53:59,373 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:53:59,373 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-14 14:53:59,373 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-14 14:53:59,373 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:59,373 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:59,375 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:59,375 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:53:59,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:53:59,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:53:59,375 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:53:59,376 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:53:59,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:59,376 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:59,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:53:59,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:59,377 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:59,377 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-14 14:53:59,378 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-14 14:53:59,378 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-14 14:53:59,378 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:53:59,378 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-14 14:53:59,378 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 14:53:59,378 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:53:59,378 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1678805631334.3b6ac335f3eded6c9d62899b5ba0c2df. 2023-03-14 14:53:59,378 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1678805631334.3b6ac335f3eded6c9d62899b5ba0c2df. started... 2023-03-14 14:53:59,379 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 3b6ac335f3eded6c9d62899b5ba0c2df 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 14:53:59,801 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101581401080e54487aa251f2b79d840418 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101581401080e54487aa251f2b79d840418 2023-03-14 14:54:00,210 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/.tmp/family1/25f826b447634b179e6a207b43dbec21 2023-03-14 14:54:00,222 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/.tmp/family1/25f826b447634b179e6a207b43dbec21 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/25f826b447634b179e6a207b43dbec21 2023-03-14 14:54:00,226 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/25f826b447634b179e6a207b43dbec21, entries=1, sequenceid=29, filesize=4.9 K 2023-03-14 14:54:00,227 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 3b6ac335f3eded6c9d62899b5ba0c2df in 848ms, sequenceid=29, compaction requested=true 2023-03-14 14:54:00,227 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 3b6ac335f3eded6c9d62899b5ba0c2df: 2023-03-14 14:54:00,227 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1678805631334.3b6ac335f3eded6c9d62899b5ba0c2df. 2023-03-14 14:54:00,227 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 14:54:00,227 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 14:54:00,227 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:00,227 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-14 14:54:00,227 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-14 14:54:00,228 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:00,228 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:00,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:00,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:00,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:00,229 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:00,229 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:54:00,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:00,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:00,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:00,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:00,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:00,230 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-14 14:54:00,230 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-14 14:54:00,230 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@27a30a52[Count = 0] remaining members to acquire global barrier 2023-03-14 14:54:00,230 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:00,231 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:00,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:00,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:00,231 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-14 14:54:00,231 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-14 14:54:00,231 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:54:00,231 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:00,231 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:54:00,231 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-14 14:54:00,232 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:00,232 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:54:00,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:00,232 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-14 14:54:00,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:00,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:00,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:00,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:00,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:00,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:00,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:00,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:00,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:00,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:54:00,234 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-14 14:54:00,234 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-14 14:54:00,234 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:54:00,234 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:54:00,234 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:00,234 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:54:00,235 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:00,235 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:00,235 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:00,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:00,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:00,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:00,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:00,235 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:54:00,235 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:54:00,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:54:00,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:00,235 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:00,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:00,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:00,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:00,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:00,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:00,237 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:00,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:00,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:00,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:00,239 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:00,239 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:54:00,239 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:54:00,239 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:00,239 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-14 14:54:00,239 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:54:00,239 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:54:00,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:54:00,239 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:00,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:54:00,239 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-14 14:54:00,239 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:00,239 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:54:00,239 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:00,239 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:00,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:54:00,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:54:00,239 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:00,339 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:54:00,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:54:00,352 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:54:00,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-14 14:54:00,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:00,355 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-14 14:54:00,355 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:54:00,355 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-14 14:54:00,355 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-14 14:54:00,356 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:00,356 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:00,357 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:00,357 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:54:00,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:54:00,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:54:00,357 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:00,357 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:54:00,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:00,358 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:00,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:54:00,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:00,359 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:00,359 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-14 14:54:00,359 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:00,359 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-14 14:54:00,359 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:54:00,359 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-14 14:54:00,359 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 14:54:00,359 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:54:00,359 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1678805631334.3b6ac335f3eded6c9d62899b5ba0c2df. 2023-03-14 14:54:00,359 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1678805631334.3b6ac335f3eded6c9d62899b5ba0c2df. started... 2023-03-14 14:54:00,360 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 3b6ac335f3eded6c9d62899b5ba0c2df 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 14:54:00,775 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010373eb1e24540047e5a3c5acc5e9b1560c to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010373eb1e24540047e5a3c5acc5e9b1560c 2023-03-14 14:54:01,184 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/.tmp/family1/a258d9e2c1884a7294a56d2d0e64e792 2023-03-14 14:54:01,189 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/.tmp/family1/a258d9e2c1884a7294a56d2d0e64e792 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/a258d9e2c1884a7294a56d2d0e64e792 2023-03-14 14:54:01,194 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/a258d9e2c1884a7294a56d2d0e64e792, entries=1, sequenceid=33, filesize=4.9 K 2023-03-14 14:54:01,194 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 3b6ac335f3eded6c9d62899b5ba0c2df in 834ms, sequenceid=33, compaction requested=true 2023-03-14 14:54:01,195 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 3b6ac335f3eded6c9d62899b5ba0c2df: 2023-03-14 14:54:01,195 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1678805631334.3b6ac335f3eded6c9d62899b5ba0c2df. 2023-03-14 14:54:01,195 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 14:54:01,195 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 14:54:01,195 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:01,195 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-14 14:54:01,195 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-14 14:54:01,196 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:01,196 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:01,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:01,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:01,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:01,196 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:01,196 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:54:01,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:01,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:01,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:01,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:01,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:01,198 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-14 14:54:01,198 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@433cf85c[Count = 0] remaining members to acquire global barrier 2023-03-14 14:54:01,198 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-14 14:54:01,198 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:01,198 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:01,198 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:01,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:01,199 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-14 14:54:01,199 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-14 14:54:01,199 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:54:01,199 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:01,199 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:54:01,199 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-14 14:54:01,199 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:01,199 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:54:01,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:01,200 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-14 14:54:01,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:01,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:01,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:01,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:01,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:01,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:01,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:01,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:01,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:01,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:54:01,202 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-14 14:54:01,202 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-14 14:54:01,202 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:54:01,202 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:54:01,202 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:01,202 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:54:01,203 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:01,203 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:54:01,203 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:01,203 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:01,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:01,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:01,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:01,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:01,203 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:54:01,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:54:01,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:01,204 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:01,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:01,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:01,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:01,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:01,205 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:01,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:01,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:01,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:01,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:01,206 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:01,206 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-14 14:54:01,206 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:54:01,206 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:01,206 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-14 14:54:01,206 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:54:01,206 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:54:01,207 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-14 14:54:01,207 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:01,207 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:54:01,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:54:01,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:54:01,207 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:54:01,207 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:01,207 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:01,207 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:01,207 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:01,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:54:01,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:54:01,307 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:54:01,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:54:01,312 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:54:01,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-14 14:54:01,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:01,314 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-14 14:54:01,314 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:54:01,314 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-14 14:54:01,314 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-14 14:54:01,314 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:01,314 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:01,315 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:54:01,315 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:01,315 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:54:01,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:54:01,315 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:01,316 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:54:01,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:01,316 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:01,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:54:01,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:01,316 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:01,316 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-14 14:54:01,316 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:01,317 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-14 14:54:01,317 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:54:01,317 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-14 14:54:01,317 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 14:54:01,317 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:54:01,317 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1678805631334.3b6ac335f3eded6c9d62899b5ba0c2df. 2023-03-14 14:54:01,317 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1678805631334.3b6ac335f3eded6c9d62899b5ba0c2df. started... 2023-03-14 14:54:01,317 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 3b6ac335f3eded6c9d62899b5ba0c2df 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 14:54:01,733 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509074c7603b43a2f4db88229f8965fec9eae to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201509074c7603b43a2f4db88229f8965fec9eae 2023-03-14 14:54:01,739 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/.tmp/family1/3930dcae063b42b7bb76ae39d58b7d2e 2023-03-14 14:54:01,746 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/.tmp/family1/3930dcae063b42b7bb76ae39d58b7d2e as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/3930dcae063b42b7bb76ae39d58b7d2e 2023-03-14 14:54:01,753 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/3930dcae063b42b7bb76ae39d58b7d2e, entries=1, sequenceid=37, filesize=4.9 K 2023-03-14 14:54:01,754 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 3b6ac335f3eded6c9d62899b5ba0c2df in 437ms, sequenceid=37, compaction requested=true 2023-03-14 14:54:01,754 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 3b6ac335f3eded6c9d62899b5ba0c2df: 2023-03-14 14:54:01,754 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1678805631334.3b6ac335f3eded6c9d62899b5ba0c2df. 2023-03-14 14:54:01,754 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 14:54:01,754 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 14:54:01,754 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:01,754 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-14 14:54:01,754 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-14 14:54:01,755 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:01,755 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:01,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:01,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:01,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:01,755 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:01,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:01,755 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:54:01,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:01,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:01,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:01,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:01,756 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-14 14:54:01,756 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-14 14:54:01,756 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@49874dcd[Count = 0] remaining members to acquire global barrier 2023-03-14 14:54:01,756 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:01,757 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:01,757 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:01,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:01,757 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-14 14:54:01,757 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-14 14:54:01,757 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:01,757 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:54:01,757 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:54:01,758 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:01,758 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-14 14:54:01,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:01,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:01,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:01,758 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:54:01,758 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-14 14:54:01,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:01,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:01,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:01,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:01,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:01,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:01,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:01,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:54:01,760 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-14 14:54:01,760 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-14 14:54:01,760 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:54:01,760 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:54:01,760 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:01,761 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:54:01,761 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:01,761 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:01,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:01,762 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:01,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:01,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:01,761 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:54:01,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:01,762 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:01,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:01,762 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:54:01,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:54:01,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:01,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:01,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:01,763 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:01,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:01,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:01,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:01,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:01,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:01,764 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:01,764 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:01,764 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:01,764 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:01,764 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-14 14:54:01,764 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:54:01,764 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:54:01,764 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:01,764 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:54:01,765 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:01,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:54:01,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:54:01,765 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:54:01,765 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:01,765 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-03-14 14:54:01,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:54:01,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:54:01,766 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-14 14:54:01,766 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:54:01,866 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:54:01,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:54:01,870 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:54:01,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-03-14 14:54:01,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:01,878 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-03-14 14:54:01,878 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:54:01,878 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-03-14 14:54:01,878 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-03-14 14:54:01,878 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:01,878 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:01,879 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:54:01,879 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:01,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:54:01,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:54:01,879 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:01,879 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:54:01,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:01,880 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:01,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:54:01,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:01,880 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:01,886 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-03-14 14:54:01,886 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:01,886 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-03-14 14:54:01,886 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:54:01,886 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-03-14 14:54:01,890 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 14:54:01,890 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1678805631334.3b6ac335f3eded6c9d62899b5ba0c2df. 2023-03-14 14:54:01,890 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:54:01,890 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1678805631334.3b6ac335f3eded6c9d62899b5ba0c2df. started... 2023-03-14 14:54:01,890 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 3b6ac335f3eded6c9d62899b5ba0c2df 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 14:54:02,308 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120b059c4fbb4fb4c03888858373c777c13 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151120b059c4fbb4fb4c03888858373c777c13 2023-03-14 14:54:02,319 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/.tmp/family1/d5dd132762ab47b4946fc8c7254e0fa3 2023-03-14 14:54:02,323 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/.tmp/family1/d5dd132762ab47b4946fc8c7254e0fa3 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/d5dd132762ab47b4946fc8c7254e0fa3 2023-03-14 14:54:02,328 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/d5dd132762ab47b4946fc8c7254e0fa3, entries=1, sequenceid=41, filesize=4.9 K 2023-03-14 14:54:02,328 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 3b6ac335f3eded6c9d62899b5ba0c2df in 438ms, sequenceid=41, compaction requested=true 2023-03-14 14:54:02,329 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 3b6ac335f3eded6c9d62899b5ba0c2df: 2023-03-14 14:54:02,329 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1678805631334.3b6ac335f3eded6c9d62899b5ba0c2df. 2023-03-14 14:54:02,329 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 14:54:02,329 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 14:54:02,329 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:02,329 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-03-14 14:54:02,329 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-03-14 14:54:02,330 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:02,330 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:02,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:02,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:02,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:02,330 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:02,330 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:54:02,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:02,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:02,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:02,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:02,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:02,331 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-03-14 14:54:02,331 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6e796d88[Count = 0] remaining members to acquire global barrier 2023-03-14 14:54:02,331 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-03-14 14:54:02,331 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:02,332 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:02,332 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:02,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:02,332 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-03-14 14:54:02,332 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:02,332 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:54:02,332 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-03-14 14:54:02,332 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:54:02,333 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:02,333 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-03-14 14:54:02,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:02,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:02,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:02,333 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:54:02,333 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-03-14 14:54:02,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:02,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:02,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:02,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:02,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:02,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:02,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:02,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:54:02,335 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-03-14 14:54:02,335 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-03-14 14:54:02,335 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:54:02,335 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:54:02,335 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:02,335 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:54:02,336 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:02,336 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:02,336 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:02,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:02,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:02,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:02,336 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:54:02,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:02,337 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:54:02,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:54:02,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:02,337 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:02,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:02,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:02,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:02,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:02,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:02,338 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:02,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:02,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:02,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:02,341 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:02,341 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:02,341 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:54:02,341 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:02,341 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:54:02,341 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:54:02,341 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-03-14 14:54:02,341 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:54:02,341 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:02,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:54:02,341 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:02,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:54:02,341 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:02,341 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:02,341 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-03-14 14:54:02,341 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:54:02,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:54:02,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:54:02,442 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:54:02,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:54:02,444 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=38031] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyPolicy 2023-03-14 14:54:02,445 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] procedure2.ProcedureExecutor(1029): Stored pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-03-14 14:54:02,446 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-03-14 14:54:02,447 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-14 14:54:02,447 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=38, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678806242447 2023-03-14 14:54:02,452 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-14 14:54:02,453 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyPolicy' and column 'family1' 2023-03-14 14:54:02,453 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-03-14 14:54:02,454 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] zookeeper.ReadOnlyZKClient(139): Connect 0x388e3d65 to 127.0.0.1:50211 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-14 14:54:02,468 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4fdfe868, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-14 14:54:02,468 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-14 14:54:03,323 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103fc0f86434aa94d9d850c08d0b4aeb14c to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103fc0f86434aa94d9d850c08d0b4aeb14c 2023-03-14 14:54:03,323 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-03-14 14:54:03,335 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-14 14:54:03,336 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:58100, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-14 14:54:03,342 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-14 14:54:03,343 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:39022, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-14 14:54:03,352 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/7019c28307a34ef2917421c2c9ebe317 first=Optional[r3] last=Optional[r6] 2023-03-14 14:54:03,352 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1678805631334.3b6ac335f3eded6c9d62899b5ba0c2df., hostname=jenkins-hbase20.apache.org,41317,1678805580877, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/7019c28307a34ef2917421c2c9ebe317}] 2023-03-14 14:54:03,356 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/7019c28307a34ef2917421c2c9ebe317 for inclusion in 3b6ac335f3eded6c9d62899b5ba0c2df/family1 2023-03-14 14:54:03,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-03-14 14:54:03,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(777): Region bounds: first= last= 2023-03-14 14:54:03,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HRegion(2446): Flush status journal for 3b6ac335f3eded6c9d62899b5ba0c2df: 2023-03-14 14:54:03,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/7019c28307a34ef2917421c2c9ebe317 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionWithWeeklyPolicy__kt3j94avrabu06b9cpunsu4qqlka6vck7gtrnub71pbhh20ns7fvplj14212ad7s/family1/7019c28307a34ef2917421c2c9ebe317 2023-03-14 14:54:03,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionWithWeeklyPolicy__kt3j94avrabu06b9cpunsu4qqlka6vck7gtrnub71pbhh20ns7fvplj14212ad7s/family1/7019c28307a34ef2917421c2c9ebe317 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/df2f1a43d95c4051bbdf70e3a6eb7398_SeqId_44_ 2023-03-14 14:54:03,362 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionWithWeeklyPolicy__kt3j94avrabu06b9cpunsu4qqlka6vck7gtrnub71pbhh20ns7fvplj14212ad7s/family1/7019c28307a34ef2917421c2c9ebe317 into 3b6ac335f3eded6c9d62899b5ba0c2df/family1 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/df2f1a43d95c4051bbdf70e3a6eb7398_SeqId_44_ - updating store file list. 2023-03-14 14:54:03,366 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/df2f1a43d95c4051bbdf70e3a6eb7398_SeqId_44_ into 3b6ac335f3eded6c9d62899b5ba0c2df/family1 2023-03-14 14:54:03,366 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionWithWeeklyPolicy__kt3j94avrabu06b9cpunsu4qqlka6vck7gtrnub71pbhh20ns7fvplj14212ad7s/family1/7019c28307a34ef2917421c2c9ebe317 into 3b6ac335f3eded6c9d62899b5ba0c2df/family1 (new location: hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/df2f1a43d95c4051bbdf70e3a6eb7398_SeqId_44_) 2023-03-14 14:54:03,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionWithWeeklyPolicy__kt3j94avrabu06b9cpunsu4qqlka6vck7gtrnub71pbhh20ns7fvplj14212ad7s/family1/7019c28307a34ef2917421c2c9ebe317 2023-03-14 14:54:03,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-14 14:54:03,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-14 14:54:03,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(1912): 3b6ac335f3eded6c9d62899b5ba0c2df/family1 is initiating minor compaction 2023-03-14 14:54:03,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@14e8e19a; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-14 14:54:03,370 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 3b6ac335f3eded6c9d62899b5ba0c2df/family1 in testMajorCompactionWithWeeklyPolicy,,1678805631334.3b6ac335f3eded6c9d62899b5ba0c2df. 2023-03-14 14:54:03,370 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/8bb4771998cb4208aae433ec671c1c69, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/c108984834db49678581f4aacb859a78, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/faff6d7680cd4c518e4597cb6c16fbcb, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/6aaa9d38306d4b53b8e2b65297617621, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/50f230331bf94e50a73f19ee69d9de87, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/25f826b447634b179e6a207b43dbec21, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/a258d9e2c1884a7294a56d2d0e64e792, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/3930dcae063b42b7bb76ae39d58b7d2e, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/d5dd132762ab47b4946fc8c7254e0fa3, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/df2f1a43d95c4051bbdf70e3a6eb7398_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/.tmp, totalSize=50.0 K 2023-03-14 14:54:03,370 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting 8bb4771998cb4208aae433ec671c1c69, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-14 14:54:03,370 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting c108984834db49678581f4aacb859a78, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-14 14:54:03,370 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting faff6d7680cd4c518e4597cb6c16fbcb, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-14 14:54:03,370 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting 6aaa9d38306d4b53b8e2b65297617621, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-14 14:54:03,370 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting 50f230331bf94e50a73f19ee69d9de87, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-14 14:54:03,370 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting 25f826b447634b179e6a207b43dbec21, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-14 14:54:03,370 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting a258d9e2c1884a7294a56d2d0e64e792, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-14 14:54:03,370 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting 3930dcae063b42b7bb76ae39d58b7d2e, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-14 14:54:03,370 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting d5dd132762ab47b4946fc8c7254e0fa3, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-14 14:54:03,370 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting df2f1a43d95c4051bbdf70e3a6eb7398_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-14 14:54:03,371 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-03-14 14:54:03,372 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 14:54:03,373 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228a3222bad9fef4364a011143d938d238b to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228a3222bad9fef4364a011143d938d238b 2023-03-14 14:54:03,374 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512312065cce0e80546fc90aabd49a22cf7a0 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512312065cce0e80546fc90aabd49a22cf7a0 2023-03-14 14:54:03,375 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101581401080e54487aa251f2b79d840418 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101581401080e54487aa251f2b79d840418 2023-03-14 14:54:03,376 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010373eb1e24540047e5a3c5acc5e9b1560c to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010373eb1e24540047e5a3c5acc5e9b1560c 2023-03-14 14:54:03,376 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-03-14 14:54:03,376 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-03-14 14:54:03,376 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-14 14:54:03,376 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-14 14:54:03,377 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-14 14:54:03,377 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-14 14:54:03,377 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-14 14:54:03,377 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-14 14:54:03,377 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-14 14:54:03,377 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-14 14:54:03,399 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] throttle.PressureAwareThroughputController(145): 3b6ac335f3eded6c9d62899b5ba0c2df#family1#compaction#49 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-14 14:54:03,424 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/.tmp/family1/884b4c25c17e474c82a3f905937ca1d0 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/884b4c25c17e474c82a3f905937ca1d0 2023-03-14 14:54:03,429 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 3b6ac335f3eded6c9d62899b5ba0c2df/family1 of 3b6ac335f3eded6c9d62899b5ba0c2df into 884b4c25c17e474c82a3f905937ca1d0(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-14 14:54:03,429 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 3b6ac335f3eded6c9d62899b5ba0c2df: 2023-03-14 14:54:03,429 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1678805631334.3b6ac335f3eded6c9d62899b5ba0c2df., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1678805643369; duration=0sec 2023-03-14 14:54:03,429 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-14 14:54:03,516 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/8bb4771998cb4208aae433ec671c1c69, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/c108984834db49678581f4aacb859a78, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/faff6d7680cd4c518e4597cb6c16fbcb, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/6aaa9d38306d4b53b8e2b65297617621, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/50f230331bf94e50a73f19ee69d9de87, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/25f826b447634b179e6a207b43dbec21, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/a258d9e2c1884a7294a56d2d0e64e792, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/3930dcae063b42b7bb76ae39d58b7d2e, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/d5dd132762ab47b4946fc8c7254e0fa3, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/df2f1a43d95c4051bbdf70e3a6eb7398_SeqId_44_] to archive 2023-03-14 14:54:03,517 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 14:54:03,518 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/8bb4771998cb4208aae433ec671c1c69 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/8bb4771998cb4208aae433ec671c1c69 2023-03-14 14:54:03,519 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/c108984834db49678581f4aacb859a78 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/c108984834db49678581f4aacb859a78 2023-03-14 14:54:03,520 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/faff6d7680cd4c518e4597cb6c16fbcb to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/faff6d7680cd4c518e4597cb6c16fbcb 2023-03-14 14:54:03,521 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/6aaa9d38306d4b53b8e2b65297617621 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/6aaa9d38306d4b53b8e2b65297617621 2023-03-14 14:54:03,522 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/50f230331bf94e50a73f19ee69d9de87 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/50f230331bf94e50a73f19ee69d9de87 2023-03-14 14:54:03,523 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/25f826b447634b179e6a207b43dbec21 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/25f826b447634b179e6a207b43dbec21 2023-03-14 14:54:03,523 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/a258d9e2c1884a7294a56d2d0e64e792 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/a258d9e2c1884a7294a56d2d0e64e792 2023-03-14 14:54:03,524 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/3930dcae063b42b7bb76ae39d58b7d2e to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/3930dcae063b42b7bb76ae39d58b7d2e 2023-03-14 14:54:03,525 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/d5dd132762ab47b4946fc8c7254e0fa3 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/d5dd132762ab47b4946fc8c7254e0fa3 2023-03-14 14:54:03,526 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/df2f1a43d95c4051bbdf70e3a6eb7398_SeqId_44_ to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/df2f1a43d95c4051bbdf70e3a6eb7398_SeqId_44_ 2023-03-14 14:54:03,848 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512055a114b82da5e4daab27b22cb6f6ad405 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512055a114b82da5e4daab27b22cb6f6ad405 2023-03-14 14:54:03,850 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-03-14 14:54:03,878 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/0b1eb80344bd42e09813c567504c828b first=Optional[r00] last=Optional[r2] 2023-03-14 14:54:03,878 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1678805631334.3b6ac335f3eded6c9d62899b5ba0c2df., hostname=jenkins-hbase20.apache.org,41317,1678805580877, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/0b1eb80344bd42e09813c567504c828b}] 2023-03-14 14:54:03,880 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/0b1eb80344bd42e09813c567504c828b for inclusion in 3b6ac335f3eded6c9d62899b5ba0c2df/family1 2023-03-14 14:54:03,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-03-14 14:54:03,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(777): Region bounds: first= last= 2023-03-14 14:54:03,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HRegion(2446): Flush status journal for 3b6ac335f3eded6c9d62899b5ba0c2df: 2023-03-14 14:54:03,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/0b1eb80344bd42e09813c567504c828b to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionWithWeeklyPolicy__apbppmqll6u7mma229j8j6744katk131rmsu42s2clvsi4t6i1hi2ut0snu7lkil/family1/0b1eb80344bd42e09813c567504c828b 2023-03-14 14:54:03,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionWithWeeklyPolicy__apbppmqll6u7mma229j8j6744katk131rmsu42s2clvsi4t6i1hi2ut0snu7lkil/family1/0b1eb80344bd42e09813c567504c828b as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/818d8a046bc04dfabcf233986b14a9a0_SeqId_47_ 2023-03-14 14:54:03,887 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionWithWeeklyPolicy__apbppmqll6u7mma229j8j6744katk131rmsu42s2clvsi4t6i1hi2ut0snu7lkil/family1/0b1eb80344bd42e09813c567504c828b into 3b6ac335f3eded6c9d62899b5ba0c2df/family1 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/818d8a046bc04dfabcf233986b14a9a0_SeqId_47_ - updating store file list. 2023-03-14 14:54:03,891 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/818d8a046bc04dfabcf233986b14a9a0_SeqId_47_ into 3b6ac335f3eded6c9d62899b5ba0c2df/family1 2023-03-14 14:54:03,891 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionWithWeeklyPolicy__apbppmqll6u7mma229j8j6744katk131rmsu42s2clvsi4t6i1hi2ut0snu7lkil/family1/0b1eb80344bd42e09813c567504c828b into 3b6ac335f3eded6c9d62899b5ba0c2df/family1 (new location: hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/818d8a046bc04dfabcf233986b14a9a0_SeqId_47_) 2023-03-14 14:54:03,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionWithWeeklyPolicy__apbppmqll6u7mma229j8j6744katk131rmsu42s2clvsi4t6i1hi2ut0snu7lkil/family1/0b1eb80344bd42e09813c567504c828b 2023-03-14 14:54:03,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-14 14:54:03,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 345120 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-14 14:54:03,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(1912): 3b6ac335f3eded6c9d62899b5ba0c2df/family1 is initiating minor compaction (all files) 2023-03-14 14:54:03,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@6878eef6; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-14 14:54:03,893 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 3b6ac335f3eded6c9d62899b5ba0c2df/family1 in testMajorCompactionWithWeeklyPolicy,,1678805631334.3b6ac335f3eded6c9d62899b5ba0c2df. 2023-03-14 14:54:03,893 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/1a9d89da9d804b878895c3f5f7ddcb74, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/884b4c25c17e474c82a3f905937ca1d0, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/818d8a046bc04dfabcf233986b14a9a0_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/.tmp, totalSize=337.0 K 2023-03-14 14:54:03,893 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting 1a9d89da9d804b878895c3f5f7ddcb74, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878806007 2023-03-14 14:54:03,893 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting 884b4c25c17e474c82a3f905937ca1d0, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621206007 2023-03-14 14:54:03,894 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting 818d8a046bc04dfabcf233986b14a9a0_SeqId_47_, keycount=1002, bloomtype=ROW, size=165.4 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878806007 2023-03-14 14:54:03,894 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-03-14 14:54:03,895 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 14:54:03,896 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511305599adb3ce5e4812aebc7faa571577b8 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511305599adb3ce5e4812aebc7faa571577b8 2023-03-14 14:54:03,897 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201f68063278f1643e693eed358c4a6e2ab to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201f68063278f1643e693eed358c4a6e2ab 2023-03-14 14:54:03,898 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205c09e7477891944c09f4cb402c61e1a86 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205c09e7477891944c09f4cb402c61e1a86 2023-03-14 14:54:03,898 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 3 expired mob files are deleted 2023-03-14 14:54:03,898 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-03-14 14:54:03,898 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-03-14 14:54:03,898 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-03-14 14:54:03,898 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-14 14:54:03,899 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=38, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-03-14 14:54:03,901 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=38, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.4550 sec 2023-03-14 14:54:03,911 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] throttle.PressureAwareThroughputController(145): 3b6ac335f3eded6c9d62899b5ba0c2df#family1#compaction#50 average throughput is 17.18 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 80.77 MB/second 2023-03-14 14:54:03,999 INFO [Listener at localhost.localdomain/44261] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=257 (was 251) - Thread LEAK? -, OpenFileDescriptor=620 (was 607) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=220 (was 260), ProcessCount=170 (was 170), AvailableMemoryMB=12496 (was 12537) 2023-03-14 14:54:04,010 INFO [Listener at localhost.localdomain/44261] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=257, OpenFileDescriptor=620, MaxFileDescriptor=60000, SystemLoadAverage=242, ProcessCount=170, AvailableMemoryMB=12495 2023-03-14 14:54:04,012 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-03-14 14:54:04,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure2.ProcedureExecutor(1029): Stored pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:04,016 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_PRE_OPERATION 2023-03-14 14:54:04,016 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly" procId is: 39 2023-03-14 14:54:04,016 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-14 14:54:04,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-03-14 14:54:04,017 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14 2023-03-14 14:54:04,018 DEBUG [HFileArchiver-9] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14 empty. 2023-03-14 14:54:04,018 DEBUG [HFileArchiver-9] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14 2023-03-14 14:54:04,018 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly regions 2023-03-14 14:54:04,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-03-14 14:54:04,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-03-14 14:54:04,427 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-03-14 14:54:04,428 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(7675): creating {ENCODED => b108573ed4edc7c6723ae22ab3b01c14, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp 2023-03-14 14:54:04,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-03-14 14:54:04,835 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 14:54:04,835 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1604): Closing b108573ed4edc7c6723ae22ab3b01c14, disabling compactions & flushes 2023-03-14 14:54:04,835 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14. 2023-03-14 14:54:04,835 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14. 2023-03-14 14:54:04,835 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14. after waiting 0 ms 2023-03-14 14:54:04,835 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14. 2023-03-14 14:54:04,835 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14. 2023-03-14 14:54:04,835 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1558): Region close journal for b108573ed4edc7c6723ae22ab3b01c14: 2023-03-14 14:54:04,838 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ADD_TO_META 2023-03-14 14:54:04,839 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1678805644839"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678805644839"}]},"ts":"1678805644839"} 2023-03-14 14:54:04,840 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-14 14:54:04,841 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-14 14:54:04,841 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678805644841"}]},"ts":"1678805644841"} 2023-03-14 14:54:04,842 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLING in hbase:meta 2023-03-14 14:54:04,844 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=b108573ed4edc7c6723ae22ab3b01c14, ASSIGN}] 2023-03-14 14:54:04,845 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=b108573ed4edc7c6723ae22ab3b01c14, ASSIGN 2023-03-14 14:54:04,846 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=b108573ed4edc7c6723ae22ab3b01c14, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,41317,1678805580877; forceNewPlan=false, retain=false 2023-03-14 14:54:04,997 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=b108573ed4edc7c6723ae22ab3b01c14, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:04,997 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1678805644997"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1678805644997"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678805644997"}]},"ts":"1678805644997"} 2023-03-14 14:54:04,999 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=41, ppid=40, state=RUNNABLE; OpenRegionProcedure b108573ed4edc7c6723ae22ab3b01c14, server=jenkins-hbase20.apache.org,41317,1678805580877}] 2023-03-14 14:54:05,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-03-14 14:54:05,151 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/.tmp/family1/6dcb0408a1fe4cdc857afae0c61b60fe as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/6dcb0408a1fe4cdc857afae0c61b60fe 2023-03-14 14:54:05,152 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14. 2023-03-14 14:54:05,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b108573ed4edc7c6723ae22ab3b01c14, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14.', STARTKEY => '', ENDKEY => ''} 2023-03-14 14:54:05,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly b108573ed4edc7c6723ae22ab3b01c14 2023-03-14 14:54:05,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 14:54:05,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for b108573ed4edc7c6723ae22ab3b01c14 2023-03-14 14:54:05,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for b108573ed4edc7c6723ae22ab3b01c14 2023-03-14 14:54:05,154 INFO [StoreOpener-b108573ed4edc7c6723ae22ab3b01c14-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region b108573ed4edc7c6723ae22ab3b01c14 2023-03-14 14:54:05,156 DEBUG [StoreOpener-b108573ed4edc7c6723ae22ab3b01c14-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1 2023-03-14 14:54:05,156 DEBUG [StoreOpener-b108573ed4edc7c6723ae22ab3b01c14-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1 2023-03-14 14:54:05,157 INFO [StoreOpener-b108573ed4edc7c6723ae22ab3b01c14-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b108573ed4edc7c6723ae22ab3b01c14 columnFamilyName family1 2023-03-14 14:54:05,157 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 3b6ac335f3eded6c9d62899b5ba0c2df/family1 of 3b6ac335f3eded6c9d62899b5ba0c2df into 6dcb0408a1fe4cdc857afae0c61b60fe(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-14 14:54:05,157 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 3b6ac335f3eded6c9d62899b5ba0c2df: 2023-03-14 14:54:05,157 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1678805631334.3b6ac335f3eded6c9d62899b5ba0c2df., storeName=family1, fileCount=3, fileSize=337.0 K (165.1 K, 6.6 K, 165.4 K), priority=2, time=1678805643892; duration=1sec 2023-03-14 14:54:05,157 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-14 14:54:05,158 INFO [StoreOpener-b108573ed4edc7c6723ae22ab3b01c14-1] regionserver.HStore(310): Store=b108573ed4edc7c6723ae22ab3b01c14/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 14:54:05,159 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14 2023-03-14 14:54:05,159 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14 2023-03-14 14:54:05,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for b108573ed4edc7c6723ae22ab3b01c14 2023-03-14 14:54:05,164 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-14 14:54:05,164 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened b108573ed4edc7c6723ae22ab3b01c14; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58979802, jitterRate=-0.12113246321678162}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-14 14:54:05,164 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for b108573ed4edc7c6723ae22ab3b01c14: 2023-03-14 14:54:05,165 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14., pid=41, masterSystemTime=1678805645150 2023-03-14 14:54:05,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14. 2023-03-14 14:54:05,166 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14. 2023-03-14 14:54:05,166 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=b108573ed4edc7c6723ae22ab3b01c14, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:05,166 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1678805645166"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1678805645166"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678805645166"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678805645166"}]},"ts":"1678805645166"} 2023-03-14 14:54:05,168 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=41, resume processing ppid=40 2023-03-14 14:54:05,169 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=40, state=SUCCESS; OpenRegionProcedure b108573ed4edc7c6723ae22ab3b01c14, server=jenkins-hbase20.apache.org,41317,1678805580877 in 168 msec 2023-03-14 14:54:05,170 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=39 2023-03-14 14:54:05,170 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=b108573ed4edc7c6723ae22ab3b01c14, ASSIGN in 325 msec 2023-03-14 14:54:05,170 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-14 14:54:05,170 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678805645170"}]},"ts":"1678805645170"} 2023-03-14 14:54:05,171 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLED in hbase:meta 2023-03-14 14:54:05,172 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_POST_OPERATION 2023-03-14 14:54:05,173 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=39, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.1600 sec 2023-03-14 14:54:05,211 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/1a9d89da9d804b878895c3f5f7ddcb74, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/884b4c25c17e474c82a3f905937ca1d0, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/818d8a046bc04dfabcf233986b14a9a0_SeqId_47_] to archive 2023-03-14 14:54:05,212 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 14:54:05,213 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/1a9d89da9d804b878895c3f5f7ddcb74 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/1a9d89da9d804b878895c3f5f7ddcb74 2023-03-14 14:54:05,214 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/884b4c25c17e474c82a3f905937ca1d0 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/884b4c25c17e474c82a3f905937ca1d0 2023-03-14 14:54:05,215 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/818d8a046bc04dfabcf233986b14a9a0_SeqId_47_ to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/family1/818d8a046bc04dfabcf233986b14a9a0_SeqId_47_ 2023-03-14 14:54:06,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-03-14 14:54:06,122 INFO [Listener at localhost.localdomain/44261] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, procId: 39 completed 2023-03-14 14:54:06,148 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:54:06,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:06,151 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-14 14:54:06,151 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:54:06,151 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-14 14:54:06,151 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-14 14:54:06,151 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:06,151 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:06,152 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:54:06,152 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:06,152 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:54:06,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:54:06,153 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:06,153 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:54:06,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:06,153 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:06,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:54:06,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:06,153 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:06,154 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:06,154 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-14 14:54:06,154 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:54:06,154 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-14 14:54:06,158 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 14:54:06,158 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:54:06,158 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14. 2023-03-14 14:54:06,158 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14. started... 2023-03-14 14:54:06,159 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b108573ed4edc7c6723ae22ab3b01c14 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-14 14:54:06,588 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113078c96ac03ab44d7fbff6c18c27020c47 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015113078c96ac03ab44d7fbff6c18c27020c47 2023-03-14 14:54:06,993 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/.tmp/family1/3921ea6df65e4027afb30801cd99f79a 2023-03-14 14:54:06,998 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/.tmp/family1/3921ea6df65e4027afb30801cd99f79a as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/3921ea6df65e4027afb30801cd99f79a 2023-03-14 14:54:07,002 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/3921ea6df65e4027afb30801cd99f79a, entries=1000, sequenceid=5, filesize=191.4 K 2023-03-14 14:54:07,003 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for b108573ed4edc7c6723ae22ab3b01c14 in 844ms, sequenceid=5, compaction requested=false 2023-03-14 14:54:07,003 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-14 14:54:07,003 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b108573ed4edc7c6723ae22ab3b01c14: 2023-03-14 14:54:07,003 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14. 2023-03-14 14:54:07,003 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 14:54:07,003 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 14:54:07,003 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:07,003 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-14 14:54:07,003 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-14 14:54:07,004 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:07,004 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:07,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:07,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:07,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:07,005 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:07,005 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:54:07,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:07,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:07,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:07,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:07,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:07,006 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-14 14:54:07,006 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@51b70b8f[Count = 0] remaining members to acquire global barrier 2023-03-14 14:54:07,006 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-14 14:54:07,006 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:07,006 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:07,006 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:07,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:07,006 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-14 14:54:07,006 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:07,006 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:54:07,006 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-14 14:54:07,007 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:54:07,007 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:07,007 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-14 14:54:07,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:07,007 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:54:07,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:07,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:07,007 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-14 14:54:07,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:07,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:07,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:07,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:07,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:07,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:07,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:07,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:54:07,009 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-14 14:54:07,009 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-14 14:54:07,009 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:54:07,009 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:54:07,009 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:07,009 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:54:07,010 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:07,010 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:54:07,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:07,010 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:07,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:07,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:07,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:07,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:07,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:54:07,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:54:07,011 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:07,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:07,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:07,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:07,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:07,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:07,011 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:07,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:07,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:07,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:07,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:07,013 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:07,013 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:07,013 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:54:07,013 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:07,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:54:07,013 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:54:07,013 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-14 14:54:07,013 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:54:07,013 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-14 14:54:07,013 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:54:07,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:54:07,013 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:07,014 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:07,014 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:07,014 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:07,014 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-14 14:54:07,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:54:07,014 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:54:07,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:54:07,114 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:54:07,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:54:07,119 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:54:07,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-14 14:54:07,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:07,120 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-14 14:54:07,120 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:54:07,121 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-14 14:54:07,121 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-14 14:54:07,121 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:07,121 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:07,122 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:54:07,122 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:07,122 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:54:07,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:54:07,122 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:07,122 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:54:07,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:07,123 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:07,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:54:07,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:07,123 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:07,123 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-14 14:54:07,124 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:07,124 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-14 14:54:07,124 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:54:07,124 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-14 14:54:07,124 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 14:54:07,124 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:54:07,124 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14. 2023-03-14 14:54:07,124 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14. started... 2023-03-14 14:54:07,124 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b108573ed4edc7c6723ae22ab3b01c14 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-14 14:54:07,544 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511287e33095e26b046ce85e255315113ce65 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511287e33095e26b046ce85e255315113ce65 2023-03-14 14:54:07,953 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/.tmp/family1/10071c4592af47af8445268934c35535 2023-03-14 14:54:07,962 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/.tmp/family1/10071c4592af47af8445268934c35535 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/10071c4592af47af8445268934c35535 2023-03-14 14:54:07,969 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/10071c4592af47af8445268934c35535, entries=1, sequenceid=9, filesize=5.0 K 2023-03-14 14:54:07,970 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for b108573ed4edc7c6723ae22ab3b01c14 in 846ms, sequenceid=9, compaction requested=false 2023-03-14 14:54:07,970 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b108573ed4edc7c6723ae22ab3b01c14: 2023-03-14 14:54:07,970 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14. 2023-03-14 14:54:07,970 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 14:54:07,970 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 14:54:07,970 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:07,970 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-14 14:54:07,970 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-14 14:54:07,972 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:07,972 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:07,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:07,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:07,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:07,972 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:07,972 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:54:07,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:07,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:07,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:07,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:07,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:07,973 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-14 14:54:07,973 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@756de7fd[Count = 0] remaining members to acquire global barrier 2023-03-14 14:54:07,973 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-14 14:54:07,973 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:07,974 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:07,974 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:07,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:07,974 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-14 14:54:07,974 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-14 14:54:07,974 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:54:07,974 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:07,974 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:54:07,975 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:07,975 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-14 14:54:07,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:07,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:07,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:07,975 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:54:07,975 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-14 14:54:07,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:07,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:07,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:07,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:07,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:07,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:07,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:07,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:54:07,977 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-14 14:54:07,977 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-14 14:54:07,977 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:54:07,977 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:54:07,977 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:07,977 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:54:07,978 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:07,978 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:07,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:07,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:07,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:07,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:07,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:07,978 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:54:07,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:07,978 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:07,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:54:07,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:54:07,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:07,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:07,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:07,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:07,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:07,980 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:07,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:07,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:07,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:07,982 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:07,982 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:07,982 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:07,982 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:54:07,982 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:07,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:54:07,982 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-14 14:54:07,982 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:54:07,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:54:07,982 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:54:07,982 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:07,982 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:54:07,982 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:07,982 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-14 14:54:07,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:54:07,982 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:07,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:54:07,982 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:54:08,083 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:54:08,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:54:08,093 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:54:08,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-14 14:54:08,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:08,097 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-14 14:54:08,097 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:54:08,097 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-14 14:54:08,097 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-14 14:54:08,098 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:08,098 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:08,100 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:54:08,100 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:08,100 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:54:08,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:54:08,101 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:08,101 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:54:08,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:08,102 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:08,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:54:08,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:08,102 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:08,103 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-14 14:54:08,103 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:08,103 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-14 14:54:08,103 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:54:08,103 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-14 14:54:08,103 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 14:54:08,103 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:54:08,103 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14. 2023-03-14 14:54:08,103 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14. started... 2023-03-14 14:54:08,103 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b108573ed4edc7c6723ae22ab3b01c14 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 14:54:08,514 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201ff038e183d684019a026b02a2cd060b5 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201ff038e183d684019a026b02a2cd060b5 2023-03-14 14:54:08,920 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/.tmp/family1/fe2a38706eae490c8ec3c0ff2186e78f 2023-03-14 14:54:08,925 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/.tmp/family1/fe2a38706eae490c8ec3c0ff2186e78f as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/fe2a38706eae490c8ec3c0ff2186e78f 2023-03-14 14:54:08,928 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/fe2a38706eae490c8ec3c0ff2186e78f, entries=1, sequenceid=13, filesize=5.0 K 2023-03-14 14:54:08,929 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b108573ed4edc7c6723ae22ab3b01c14 in 826ms, sequenceid=13, compaction requested=true 2023-03-14 14:54:08,930 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b108573ed4edc7c6723ae22ab3b01c14: 2023-03-14 14:54:08,930 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14. 2023-03-14 14:54:08,930 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 14:54:08,930 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 14:54:08,930 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:08,930 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-14 14:54:08,930 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-14 14:54:08,931 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:08,931 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:08,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:08,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:08,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:08,931 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:08,931 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:54:08,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:08,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:08,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:08,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:08,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:08,932 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-14 14:54:08,932 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6f725b8[Count = 0] remaining members to acquire global barrier 2023-03-14 14:54:08,932 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-14 14:54:08,933 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:08,933 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:08,933 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:08,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:08,933 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-14 14:54:08,933 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-14 14:54:08,933 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:54:08,933 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:08,933 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:54:08,934 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:08,934 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-14 14:54:08,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:08,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:08,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:08,934 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:54:08,934 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-14 14:54:08,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:08,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:08,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:08,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:08,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:08,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:08,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:08,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:54:08,936 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-14 14:54:08,936 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-14 14:54:08,936 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:54:08,936 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:54:08,936 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:08,936 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:54:08,937 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:08,937 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:08,937 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:08,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:08,937 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:54:08,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:08,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:08,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:08,938 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:54:08,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:54:08,938 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:08,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:08,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:08,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:08,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:08,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:08,939 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:08,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:08,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:08,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:08,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:08,940 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:08,940 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:54:08,940 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:08,940 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:54:08,940 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-14 14:54:08,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:54:08,940 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-14 14:54:08,940 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:54:08,940 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:54:08,940 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:08,940 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:54:08,940 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:08,940 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:54:08,941 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:08,941 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-14 14:54:08,941 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:54:08,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:54:08,941 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:08,941 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:09,041 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:54:09,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:54:09,045 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:54:09,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-14 14:54:09,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:09,047 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-14 14:54:09,047 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:54:09,047 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-14 14:54:09,047 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-14 14:54:09,048 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:09,048 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:09,048 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:54:09,048 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:09,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:54:09,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:54:09,049 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:09,049 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:54:09,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:09,049 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:09,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:54:09,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:09,049 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:09,049 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-14 14:54:09,050 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:09,050 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-14 14:54:09,050 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:54:09,050 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-14 14:54:09,050 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 14:54:09,050 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:54:09,050 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14. 2023-03-14 14:54:09,050 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14. started... 2023-03-14 14:54:09,050 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b108573ed4edc7c6723ae22ab3b01c14 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 14:54:09,465 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205fe0aa583990d45b092f81bd65d45ddae to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205fe0aa583990d45b092f81bd65d45ddae 2023-03-14 14:54:09,877 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/.tmp/family1/672ffcbc740147b1bd0a76d470456be6 2023-03-14 14:54:09,883 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/.tmp/family1/672ffcbc740147b1bd0a76d470456be6 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/672ffcbc740147b1bd0a76d470456be6 2023-03-14 14:54:09,888 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/672ffcbc740147b1bd0a76d470456be6, entries=1, sequenceid=17, filesize=5.0 K 2023-03-14 14:54:09,889 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b108573ed4edc7c6723ae22ab3b01c14 in 839ms, sequenceid=17, compaction requested=true 2023-03-14 14:54:09,889 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b108573ed4edc7c6723ae22ab3b01c14: 2023-03-14 14:54:09,889 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14. 2023-03-14 14:54:09,889 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 14:54:09,889 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 14:54:09,889 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:09,889 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-14 14:54:09,890 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-14 14:54:09,891 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:09,891 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:09,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:09,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:09,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:09,891 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:09,891 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:54:09,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:09,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:09,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:09,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:09,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:09,892 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-14 14:54:09,892 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@23471dc3[Count = 0] remaining members to acquire global barrier 2023-03-14 14:54:09,892 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-14 14:54:09,892 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:09,892 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:09,892 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:09,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:09,893 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-14 14:54:09,893 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:09,893 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:54:09,893 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-14 14:54:09,893 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:54:09,893 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:09,893 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-14 14:54:09,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:09,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:09,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:09,893 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:54:09,894 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-14 14:54:09,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:09,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:09,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:09,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:09,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:09,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:09,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:09,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:54:09,895 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-14 14:54:09,895 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-14 14:54:09,895 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:54:09,895 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:54:09,895 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:09,895 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:54:09,896 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:09,896 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:09,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:09,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:09,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:09,896 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:54:09,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:09,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:09,896 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:09,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:54:09,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:09,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:54:09,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:09,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:09,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:09,897 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:09,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:09,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:09,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:09,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:09,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:09,899 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:54:09,899 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:09,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:54:09,899 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:09,899 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:54:09,899 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:54:09,899 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:09,899 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-14 14:54:09,899 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:54:09,899 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-14 14:54:09,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:54:09,899 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:09,899 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:09,899 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:09,899 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:09,899 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-14 14:54:09,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:54:09,899 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:54:09,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:54:09,999 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:54:10,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:54:10,004 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:54:10,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-14 14:54:10,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:10,006 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-14 14:54:10,006 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:54:10,006 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-14 14:54:10,006 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-14 14:54:10,007 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:10,007 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:10,009 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:10,009 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:54:10,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:54:10,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:54:10,009 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:10,009 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:54:10,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:10,009 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:10,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:54:10,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:10,010 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:10,010 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-14 14:54:10,010 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:10,010 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-14 14:54:10,010 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:54:10,010 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-14 14:54:10,011 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 14:54:10,011 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:54:10,011 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14. 2023-03-14 14:54:10,011 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14. started... 2023-03-14 14:54:10,011 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b108573ed4edc7c6723ae22ab3b01c14 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 14:54:10,193 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-14 14:54:10,193 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4689ef6f to 127.0.0.1:50211 2023-03-14 14:54:10,193 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-14 14:54:10,194 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-14 14:54:10,194 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7d43bd40 to 127.0.0.1:50211 2023-03-14 14:54:10,194 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-14 14:54:10,194 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-14 14:54:10,194 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x388e3d65 to 127.0.0.1:50211 2023-03-14 14:54:10,194 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-14 14:54:10,432 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228946b33bce7314e4b908d3e5b236ca238 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228946b33bce7314e4b908d3e5b236ca238 2023-03-14 14:54:10,700 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-14 14:54:10,840 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/.tmp/family1/a0a88e5f62974e75badcec7a63c283ea 2023-03-14 14:54:10,846 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/.tmp/family1/a0a88e5f62974e75badcec7a63c283ea as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/a0a88e5f62974e75badcec7a63c283ea 2023-03-14 14:54:10,851 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/a0a88e5f62974e75badcec7a63c283ea, entries=1, sequenceid=21, filesize=5.0 K 2023-03-14 14:54:10,852 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b108573ed4edc7c6723ae22ab3b01c14 in 841ms, sequenceid=21, compaction requested=true 2023-03-14 14:54:10,852 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b108573ed4edc7c6723ae22ab3b01c14: 2023-03-14 14:54:10,852 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14. 2023-03-14 14:54:10,853 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 14:54:10,853 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 14:54:10,853 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:10,853 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-14 14:54:10,853 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-14 14:54:10,854 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:10,854 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:10,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:10,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:10,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:10,855 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:10,855 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:54:10,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:10,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:10,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:10,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:10,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:10,856 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-14 14:54:10,856 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4a459157[Count = 0] remaining members to acquire global barrier 2023-03-14 14:54:10,856 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-14 14:54:10,857 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:10,857 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:10,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:10,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:10,858 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-14 14:54:10,858 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-14 14:54:10,858 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:10,858 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:54:10,858 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:54:10,859 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-14 14:54:10,859 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:10,859 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:54:10,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:10,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:10,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:10,859 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-14 14:54:10,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:10,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:10,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:10,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:10,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:10,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:10,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:10,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:54:10,861 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-14 14:54:10,861 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-14 14:54:10,861 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:54:10,861 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:54:10,861 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:10,861 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:54:10,862 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:10,862 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:10,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:10,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:10,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:10,862 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:10,862 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:54:10,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:10,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:10,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:54:10,863 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:10,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:54:10,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:10,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:10,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:10,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:10,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:10,864 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:10,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:10,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:10,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:10,865 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:10,865 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:10,865 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:54:10,865 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:10,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:54:10,865 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-14 14:54:10,865 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:54:10,865 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:54:10,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:54:10,865 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:54:10,865 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:10,865 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:10,865 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:10,865 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:10,865 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-14 14:54:10,865 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:54:10,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:54:10,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:54:10,966 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:54:10,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:54:10,970 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:54:10,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-14 14:54:10,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:10,972 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-14 14:54:10,972 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:54:10,972 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-14 14:54:10,972 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-14 14:54:10,973 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:10,973 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:10,974 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:54:10,974 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:10,974 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:54:10,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:54:10,975 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:10,975 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:54:10,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:10,975 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:10,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:54:10,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:10,976 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:10,976 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-14 14:54:10,976 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:10,976 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-14 14:54:10,976 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:54:10,976 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-14 14:54:10,976 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 14:54:10,976 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:54:10,976 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14. 2023-03-14 14:54:10,976 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14. started... 2023-03-14 14:54:10,976 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b108573ed4edc7c6723ae22ab3b01c14 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 14:54:11,398 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231b5580e3d62404bcaa303b6e932080390 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231b5580e3d62404bcaa303b6e932080390 2023-03-14 14:54:11,806 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/.tmp/family1/496516398e5d46589bf91dec2e6c08e5 2023-03-14 14:54:11,816 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/.tmp/family1/496516398e5d46589bf91dec2e6c08e5 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/496516398e5d46589bf91dec2e6c08e5 2023-03-14 14:54:11,822 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/496516398e5d46589bf91dec2e6c08e5, entries=1, sequenceid=25, filesize=5.0 K 2023-03-14 14:54:11,823 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b108573ed4edc7c6723ae22ab3b01c14 in 847ms, sequenceid=25, compaction requested=true 2023-03-14 14:54:11,823 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b108573ed4edc7c6723ae22ab3b01c14: 2023-03-14 14:54:11,823 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14. 2023-03-14 14:54:11,823 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 14:54:11,823 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 14:54:11,824 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:11,824 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-14 14:54:11,824 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-14 14:54:11,825 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:11,825 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:11,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:11,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:11,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:11,826 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:11,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:11,826 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:54:11,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:11,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:11,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:11,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:11,828 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-14 14:54:11,828 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@500dc5ed[Count = 0] remaining members to acquire global barrier 2023-03-14 14:54:11,828 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-14 14:54:11,828 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:11,829 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:11,829 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:11,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:11,829 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-14 14:54:11,829 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-14 14:54:11,829 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:54:11,829 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:11,829 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:54:11,830 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:11,830 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-14 14:54:11,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:11,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:11,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:11,830 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:54:11,831 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-14 14:54:11,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:11,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:11,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:11,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:11,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:11,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:11,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:11,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:54:11,834 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-14 14:54:11,834 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-14 14:54:11,834 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:54:11,834 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:54:11,834 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:11,834 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:54:11,835 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:11,835 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:11,836 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:11,836 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:54:11,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:11,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:11,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:11,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:11,836 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:54:11,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:54:11,836 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:11,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:11,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:11,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:11,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:11,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:11,838 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:11,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:11,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:11,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:11,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:11,841 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:11,841 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:54:11,841 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:54:11,841 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:11,841 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:11,841 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:11,841 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-14 14:54:11,841 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:54:11,841 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:54:11,841 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:54:11,841 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:11,841 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-14 14:54:11,842 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:11,842 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:11,842 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-14 14:54:11,842 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:54:11,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:54:11,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:54:11,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:54:11,942 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:54:11,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:54:11,953 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:54:11,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-14 14:54:11,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:11,956 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-14 14:54:11,956 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:54:11,956 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-14 14:54:11,956 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-14 14:54:11,957 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:11,957 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:11,959 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:54:11,959 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:11,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:54:11,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:54:11,960 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:11,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:11,960 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:54:11,960 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:11,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:54:11,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:11,961 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:11,962 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-14 14:54:11,962 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:11,962 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-14 14:54:11,962 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:54:11,962 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-14 14:54:11,962 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 14:54:11,962 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:54:11,962 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14. 2023-03-14 14:54:11,962 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14. started... 2023-03-14 14:54:11,963 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b108573ed4edc7c6723ae22ab3b01c14 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 14:54:12,390 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601012986ad0a6b724947991a74b076ccbcb6 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601012986ad0a6b724947991a74b076ccbcb6 2023-03-14 14:54:12,798 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/.tmp/family1/7025e6a3a54445a09820550b3ca9ead4 2023-03-14 14:54:12,810 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/.tmp/family1/7025e6a3a54445a09820550b3ca9ead4 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/7025e6a3a54445a09820550b3ca9ead4 2023-03-14 14:54:12,816 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/7025e6a3a54445a09820550b3ca9ead4, entries=1, sequenceid=29, filesize=5.0 K 2023-03-14 14:54:12,817 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b108573ed4edc7c6723ae22ab3b01c14 in 854ms, sequenceid=29, compaction requested=true 2023-03-14 14:54:12,817 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b108573ed4edc7c6723ae22ab3b01c14: 2023-03-14 14:54:12,817 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14. 2023-03-14 14:54:12,817 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 14:54:12,817 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 14:54:12,817 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:12,817 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-14 14:54:12,818 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-14 14:54:12,819 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:12,819 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:12,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:12,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:12,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:12,819 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:12,820 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:54:12,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:12,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:12,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:12,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:12,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:12,821 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-14 14:54:12,821 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6f68f0b1[Count = 0] remaining members to acquire global barrier 2023-03-14 14:54:12,821 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-14 14:54:12,821 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:12,822 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:12,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:12,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:12,822 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-14 14:54:12,822 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-14 14:54:12,822 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:54:12,822 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:12,822 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:54:12,824 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:12,824 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-14 14:54:12,824 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:54:12,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:12,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:12,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:12,824 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-14 14:54:12,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:12,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:12,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:12,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:12,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:12,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:12,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:12,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:54:12,827 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-14 14:54:12,827 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-14 14:54:12,827 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:54:12,827 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:54:12,827 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:12,827 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:54:12,828 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:12,828 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:12,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:12,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:12,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:12,828 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:12,828 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:54:12,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:12,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:12,829 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:54:12,829 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:12,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:54:12,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:12,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:12,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:12,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:12,830 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:12,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:12,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:12,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:12,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:12,833 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:12,833 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:54:12,833 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:12,833 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-14 14:54:12,833 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:54:12,833 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:12,833 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-14 14:54:12,833 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:54:12,833 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:54:12,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:54:12,833 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:54:12,833 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-14 14:54:12,833 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:12,834 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:54:12,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:54:12,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:54:12,834 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:12,834 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:12,834 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:12,934 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:54:12,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:54:12,948 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:54:12,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-14 14:54:12,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:12,951 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-14 14:54:12,951 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:54:12,951 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-14 14:54:12,951 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-14 14:54:12,952 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:12,952 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:12,953 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:54:12,953 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:12,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:54:12,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:54:12,954 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:12,954 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:54:12,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:12,954 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:12,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:54:12,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:12,955 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:12,955 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-14 14:54:12,955 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:12,956 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-14 14:54:12,956 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:54:12,956 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-14 14:54:12,956 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 14:54:12,956 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:54:12,956 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14. 2023-03-14 14:54:12,956 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14. started... 2023-03-14 14:54:12,956 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b108573ed4edc7c6723ae22ab3b01c14 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 14:54:13,380 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010386b2eb0242574c70b8b6f72002520e16 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2016010386b2eb0242574c70b8b6f72002520e16 2023-03-14 14:54:13,787 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/.tmp/family1/4e8b1a150f614390bd128d6805d2db91 2023-03-14 14:54:13,799 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/.tmp/family1/4e8b1a150f614390bd128d6805d2db91 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/4e8b1a150f614390bd128d6805d2db91 2023-03-14 14:54:13,803 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/4e8b1a150f614390bd128d6805d2db91, entries=1, sequenceid=33, filesize=5.0 K 2023-03-14 14:54:13,804 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b108573ed4edc7c6723ae22ab3b01c14 in 848ms, sequenceid=33, compaction requested=true 2023-03-14 14:54:13,804 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b108573ed4edc7c6723ae22ab3b01c14: 2023-03-14 14:54:13,804 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14. 2023-03-14 14:54:13,804 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 14:54:13,804 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 14:54:13,804 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:13,804 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-14 14:54:13,804 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-14 14:54:13,805 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:13,805 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:13,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:13,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:13,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:13,806 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:13,806 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:54:13,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:13,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:13,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:13,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:13,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:13,807 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-14 14:54:13,807 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@745a419a[Count = 0] remaining members to acquire global barrier 2023-03-14 14:54:13,807 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-14 14:54:13,807 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:13,808 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:13,808 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:13,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:13,808 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-14 14:54:13,808 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-14 14:54:13,808 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:54:13,808 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:13,808 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:54:13,809 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:13,809 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-14 14:54:13,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:13,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:13,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:13,809 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:54:13,809 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-14 14:54:13,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:13,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:13,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:13,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:13,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:13,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:13,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:13,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:54:13,810 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-14 14:54:13,810 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-14 14:54:13,810 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:54:13,810 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:54:13,811 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:13,811 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:54:13,811 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:13,811 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:13,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:13,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:13,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:13,812 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:13,812 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:54:13,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:13,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:13,812 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:13,812 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:54:13,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:54:13,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:13,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:13,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:13,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:13,813 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:13,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:13,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:13,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:13,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:13,814 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:13,814 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:13,814 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:13,814 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:13,814 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:13,814 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:13,814 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:13,814 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:54:13,814 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:54:13,814 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-14 14:54:13,814 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:54:13,814 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:54:13,814 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:54:13,814 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-14 14:54:13,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:54:13,814 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-14 14:54:13,814 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:54:13,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:54:13,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:54:13,915 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:54:13,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:54:13,924 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:54:13,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-14 14:54:13,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:13,927 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-14 14:54:13,927 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:54:13,927 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-14 14:54:13,927 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-14 14:54:13,928 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:13,928 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:13,929 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:54:13,929 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:13,929 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:54:13,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:54:13,930 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:13,930 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:54:13,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:13,931 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:13,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:54:13,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:13,931 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:13,932 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-14 14:54:13,932 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:13,932 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-14 14:54:13,932 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:54:13,932 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-14 14:54:13,933 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 14:54:13,933 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:54:13,933 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14. 2023-03-14 14:54:13,933 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14. started... 2023-03-14 14:54:13,933 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b108573ed4edc7c6723ae22ab3b01c14 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 14:54:14,348 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907cd7527b75529438db2993fb40305618a to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20150907cd7527b75529438db2993fb40305618a 2023-03-14 14:54:14,754 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/.tmp/family1/371ee9fc68c54628bd601993a76bbcd0 2023-03-14 14:54:14,759 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/.tmp/family1/371ee9fc68c54628bd601993a76bbcd0 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/371ee9fc68c54628bd601993a76bbcd0 2023-03-14 14:54:14,763 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/371ee9fc68c54628bd601993a76bbcd0, entries=1, sequenceid=37, filesize=5.0 K 2023-03-14 14:54:14,764 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b108573ed4edc7c6723ae22ab3b01c14 in 831ms, sequenceid=37, compaction requested=true 2023-03-14 14:54:14,764 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b108573ed4edc7c6723ae22ab3b01c14: 2023-03-14 14:54:14,764 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14. 2023-03-14 14:54:14,764 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 14:54:14,764 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 14:54:14,764 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:14,764 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-14 14:54:14,764 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-14 14:54:14,765 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:14,765 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:14,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:14,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:14,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:14,765 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:14,765 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:54:14,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:14,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:14,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:14,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:14,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:14,766 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-14 14:54:14,767 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@12f3a96f[Count = 0] remaining members to acquire global barrier 2023-03-14 14:54:14,767 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-14 14:54:14,767 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:14,767 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:14,767 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:14,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:14,767 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-14 14:54:14,767 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-14 14:54:14,767 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:14,768 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:54:14,767 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:54:14,768 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:14,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:14,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:14,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:14,768 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-14 14:54:14,768 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:54:14,768 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-14 14:54:14,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:14,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:14,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:14,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:14,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:14,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:14,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:14,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:54:14,770 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-14 14:54:14,770 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-14 14:54:14,770 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:54:14,770 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:54:14,770 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:14,770 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:54:14,771 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:14,771 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:14,771 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:54:14,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:14,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:14,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:14,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:14,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:14,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:54:14,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:54:14,771 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:14,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:14,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:14,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:14,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:14,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:14,772 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:14,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:14,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:14,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:14,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:14,775 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:14,775 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:54:14,775 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-14 14:54:14,775 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:54:14,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:54:14,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:54:14,775 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:54:14,775 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:54:14,775 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:14,775 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-14 14:54:14,775 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:14,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:54:14,775 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-14 14:54:14,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:54:14,775 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:14,775 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:54:14,775 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:14,775 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:14,775 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:14,875 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:54:14,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:54:14,880 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:54:14,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-03-14 14:54:14,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:14,882 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-14 14:54:14,882 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:54:14,882 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-03-14 14:54:14,882 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-03-14 14:54:14,882 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:14,882 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:14,883 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:54:14,883 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:14,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:54:14,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:54:14,883 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:14,883 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:54:14,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:14,884 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:14,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:54:14,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:14,884 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:14,884 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-03-14 14:54:14,884 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:14,884 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-03-14 14:54:14,884 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:54:14,884 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-03-14 14:54:14,886 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 14:54:14,886 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:54:14,886 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14. 2023-03-14 14:54:14,886 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14. started... 2023-03-14 14:54:14,886 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b108573ed4edc7c6723ae22ab3b01c14 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 14:54:15,300 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120d1649ed710e5453b9e315ac35877503d to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120d1649ed710e5453b9e315ac35877503d 2023-03-14 14:54:15,705 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/.tmp/family1/12c726c6e81240bbb22e318ac9844305 2023-03-14 14:54:15,710 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/.tmp/family1/12c726c6e81240bbb22e318ac9844305 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/12c726c6e81240bbb22e318ac9844305 2023-03-14 14:54:15,714 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/12c726c6e81240bbb22e318ac9844305, entries=1, sequenceid=41, filesize=5.0 K 2023-03-14 14:54:15,715 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b108573ed4edc7c6723ae22ab3b01c14 in 829ms, sequenceid=41, compaction requested=true 2023-03-14 14:54:15,715 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b108573ed4edc7c6723ae22ab3b01c14: 2023-03-14 14:54:15,715 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14. 2023-03-14 14:54:15,715 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 14:54:15,715 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 14:54:15,715 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:15,715 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-03-14 14:54:15,715 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-03-14 14:54:15,716 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:15,716 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:15,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:15,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:15,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:15,717 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:15,717 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:54:15,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:15,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:15,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:15,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:15,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:15,718 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-03-14 14:54:15,718 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2cef2471[Count = 0] remaining members to acquire global barrier 2023-03-14 14:54:15,718 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-03-14 14:54:15,718 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:15,719 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:15,719 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:15,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:15,719 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-03-14 14:54:15,719 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-03-14 14:54:15,719 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:15,719 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:54:15,719 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:54:15,720 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:15,720 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-03-14 14:54:15,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:15,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:15,720 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:54:15,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:15,720 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-03-14 14:54:15,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:15,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:15,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:15,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:15,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:15,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:15,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:15,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:54:15,721 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-03-14 14:54:15,722 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-03-14 14:54:15,722 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:54:15,722 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:54:15,722 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:15,722 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:54:15,722 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:15,722 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:15,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:15,723 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:15,723 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:54:15,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:15,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:15,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:15,723 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:54:15,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:54:15,723 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:15,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:15,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:15,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:15,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:15,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:15,724 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:15,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:15,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:15,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:15,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:15,727 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:54:15,727 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:54:15,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:54:15,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:54:15,728 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:15,728 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:15,728 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:15,728 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:15,728 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:15,728 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:15,728 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:15,728 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:54:15,728 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-03-14 14:54:15,728 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:54:15,728 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-03-14 14:54:15,728 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-03-14 14:54:15,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:54:15,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:54:15,728 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:54:15,829 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:54:15,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:54:15,831 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=38031] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:15,832 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-14 14:54:15,833 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-14 14:54:15,833 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-14 14:54:15,833 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=42, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678806255833 2023-03-14 14:54:15,836 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-14 14:54:15,836 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-03-14 14:54:15,837 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-14 14:54:15,837 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] zookeeper.ReadOnlyZKClient(139): Connect 0x5d5d87af to 127.0.0.1:50211 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-14 14:54:15,840 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6597652a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-14 14:54:15,840 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-14 14:54:16,677 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601034ec65ff7ef184f8e89611c123bc6efd6 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601034ec65ff7ef184f8e89611c123bc6efd6 2023-03-14 14:54:16,678 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-14 14:54:16,690 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-14 14:54:16,691 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:45356, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-14 14:54:16,698 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-14 14:54:16,700 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:57598, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-14 14:54:16,710 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/747133c6b71348e88e84c1b0835efefc first=Optional[r3] last=Optional[r6] 2023-03-14 14:54:16,710 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14., hostname=jenkins-hbase20.apache.org,41317,1678805580877, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/747133c6b71348e88e84c1b0835efefc}] 2023-03-14 14:54:16,716 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/747133c6b71348e88e84c1b0835efefc for inclusion in b108573ed4edc7c6723ae22ab3b01c14/family1 2023-03-14 14:54:16,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-03-14 14:54:16,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(777): Region bounds: first= last= 2023-03-14 14:54:16,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HRegion(2446): Flush status journal for b108573ed4edc7c6723ae22ab3b01c14: 2023-03-14 14:54:16,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/747133c6b71348e88e84c1b0835efefc to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__gj66splal18v8p6ns6kgrvdteh9q4i1hqaqcpeq7tt0bsk460q0pgl2cb433k0lh/family1/747133c6b71348e88e84c1b0835efefc 2023-03-14 14:54:16,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__gj66splal18v8p6ns6kgrvdteh9q4i1hqaqcpeq7tt0bsk460q0pgl2cb433k0lh/family1/747133c6b71348e88e84c1b0835efefc as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/dd82080a70bd4f0484cc26dea87353f7_SeqId_44_ 2023-03-14 14:54:16,722 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__gj66splal18v8p6ns6kgrvdteh9q4i1hqaqcpeq7tt0bsk460q0pgl2cb433k0lh/family1/747133c6b71348e88e84c1b0835efefc into b108573ed4edc7c6723ae22ab3b01c14/family1 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/dd82080a70bd4f0484cc26dea87353f7_SeqId_44_ - updating store file list. 2023-03-14 14:54:16,725 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/dd82080a70bd4f0484cc26dea87353f7_SeqId_44_ into b108573ed4edc7c6723ae22ab3b01c14/family1 2023-03-14 14:54:16,726 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__gj66splal18v8p6ns6kgrvdteh9q4i1hqaqcpeq7tt0bsk460q0pgl2cb433k0lh/family1/747133c6b71348e88e84c1b0835efefc into b108573ed4edc7c6723ae22ab3b01c14/family1 (new location: hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/dd82080a70bd4f0484cc26dea87353f7_SeqId_44_) 2023-03-14 14:54:16,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__gj66splal18v8p6ns6kgrvdteh9q4i1hqaqcpeq7tt0bsk460q0pgl2cb433k0lh/family1/747133c6b71348e88e84c1b0835efefc 2023-03-14 14:54:16,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-14 14:54:16,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51565 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-14 14:54:16,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(1912): b108573ed4edc7c6723ae22ab3b01c14/family1 is initiating minor compaction 2023-03-14 14:54:16,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@54606de2; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-14 14:54:16,731 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of b108573ed4edc7c6723ae22ab3b01c14/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14. 2023-03-14 14:54:16,731 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/10071c4592af47af8445268934c35535, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/fe2a38706eae490c8ec3c0ff2186e78f, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/672ffcbc740147b1bd0a76d470456be6, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/a0a88e5f62974e75badcec7a63c283ea, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/496516398e5d46589bf91dec2e6c08e5, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/7025e6a3a54445a09820550b3ca9ead4, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/4e8b1a150f614390bd128d6805d2db91, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/371ee9fc68c54628bd601993a76bbcd0, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/12c726c6e81240bbb22e318ac9844305, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/dd82080a70bd4f0484cc26dea87353f7_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/.tmp, totalSize=50.4 K 2023-03-14 14:54:16,731 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting 10071c4592af47af8445268934c35535, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-14 14:54:16,732 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting fe2a38706eae490c8ec3c0ff2186e78f, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-14 14:54:16,732 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting 672ffcbc740147b1bd0a76d470456be6, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-14 14:54:16,732 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting a0a88e5f62974e75badcec7a63c283ea, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-14 14:54:16,732 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting 496516398e5d46589bf91dec2e6c08e5, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-14 14:54:16,732 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting 7025e6a3a54445a09820550b3ca9ead4, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-14 14:54:16,732 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting 4e8b1a150f614390bd128d6805d2db91, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-14 14:54:16,732 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting 371ee9fc68c54628bd601993a76bbcd0, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-14 14:54:16,732 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting 12c726c6e81240bbb22e318ac9844305, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-14 14:54:16,732 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting dd82080a70bd4f0484cc26dea87353f7_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-14 14:54:16,734 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-14 14:54:16,735 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 14:54:16,736 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228946b33bce7314e4b908d3e5b236ca238 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228946b33bce7314e4b908d3e5b236ca238 2023-03-14 14:54:16,738 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231b5580e3d62404bcaa303b6e932080390 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231b5580e3d62404bcaa303b6e932080390 2023-03-14 14:54:16,739 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601012986ad0a6b724947991a74b076ccbcb6 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601012986ad0a6b724947991a74b076ccbcb6 2023-03-14 14:54:16,740 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2016010386b2eb0242574c70b8b6f72002520e16 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2016010386b2eb0242574c70b8b6f72002520e16 2023-03-14 14:54:16,740 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 4 expired mob files are deleted 2023-03-14 14:54:16,740 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-03-14 14:54:16,741 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-14 14:54:16,741 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-14 14:54:16,741 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-14 14:54:16,741 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-14 14:54:16,741 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-14 14:54:16,741 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-14 14:54:16,741 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-14 14:54:16,741 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-14 14:54:16,780 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] throttle.PressureAwareThroughputController(145): b108573ed4edc7c6723ae22ab3b01c14#family1#compaction#61 average throughput is 0.20 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 80.77 MB/second 2023-03-14 14:54:17,604 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/.tmp/family1/8e85897b033b4a8689385cad0793eece as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/8e85897b033b4a8689385cad0793eece 2023-03-14 14:54:17,606 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120531f45dcad75f475aa13712da039680b3 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120531f45dcad75f475aa13712da039680b3 2023-03-14 14:54:17,607 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-14 14:54:17,609 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in b108573ed4edc7c6723ae22ab3b01c14/family1 of b108573ed4edc7c6723ae22ab3b01c14 into 8e85897b033b4a8689385cad0793eece(size=6.8 K), total size for store is 198.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-14 14:54:17,609 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for b108573ed4edc7c6723ae22ab3b01c14: 2023-03-14 14:54:17,609 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14., storeName=family1, fileCount=10, fileSize=50.4 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1678805656731; duration=0sec 2023-03-14 14:54:17,609 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-14 14:54:17,635 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/657e01b024234f7c8bf77b96ef62fb12 first=Optional[r00] last=Optional[r2] 2023-03-14 14:54:17,636 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14., hostname=jenkins-hbase20.apache.org,41317,1678805580877, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/657e01b024234f7c8bf77b96ef62fb12}] 2023-03-14 14:54:17,638 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/657e01b024234f7c8bf77b96ef62fb12 for inclusion in b108573ed4edc7c6723ae22ab3b01c14/family1 2023-03-14 14:54:17,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-03-14 14:54:17,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(777): Region bounds: first= last= 2023-03-14 14:54:17,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HRegion(2446): Flush status journal for b108573ed4edc7c6723ae22ab3b01c14: 2023-03-14 14:54:17,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/657e01b024234f7c8bf77b96ef62fb12 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__rdf6qe7aoh484i68bvuenchn7tpuaco7cokc1j31kn8leud4hepccf1opse6lgp1/family1/657e01b024234f7c8bf77b96ef62fb12 2023-03-14 14:54:17,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__rdf6qe7aoh484i68bvuenchn7tpuaco7cokc1j31kn8leud4hepccf1opse6lgp1/family1/657e01b024234f7c8bf77b96ef62fb12 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/e940b330521141aaa8ab5c770a193979_SeqId_47_ 2023-03-14 14:54:17,645 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__rdf6qe7aoh484i68bvuenchn7tpuaco7cokc1j31kn8leud4hepccf1opse6lgp1/family1/657e01b024234f7c8bf77b96ef62fb12 into b108573ed4edc7c6723ae22ab3b01c14/family1 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/e940b330521141aaa8ab5c770a193979_SeqId_47_ - updating store file list. 2023-03-14 14:54:17,648 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/e940b330521141aaa8ab5c770a193979_SeqId_47_ into b108573ed4edc7c6723ae22ab3b01c14/family1 2023-03-14 14:54:17,648 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__rdf6qe7aoh484i68bvuenchn7tpuaco7cokc1j31kn8leud4hepccf1opse6lgp1/family1/657e01b024234f7c8bf77b96ef62fb12 into b108573ed4edc7c6723ae22ab3b01c14/family1 (new location: hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/e940b330521141aaa8ab5c770a193979_SeqId_47_) 2023-03-14 14:54:17,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__rdf6qe7aoh484i68bvuenchn7tpuaco7cokc1j31kn8leud4hepccf1opse6lgp1/family1/657e01b024234f7c8bf77b96ef62fb12 2023-03-14 14:54:17,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-14 14:54:17,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 399433 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-14 14:54:17,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(1912): b108573ed4edc7c6723ae22ab3b01c14/family1 is initiating minor compaction (all files) 2023-03-14 14:54:17,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@2365a263; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-14 14:54:17,650 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of b108573ed4edc7c6723ae22ab3b01c14/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14. 2023-03-14 14:54:17,650 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/3921ea6df65e4027afb30801cd99f79a, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/8e85897b033b4a8689385cad0793eece, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/e940b330521141aaa8ab5c770a193979_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/.tmp, totalSize=390.1 K 2023-03-14 14:54:17,650 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting 3921ea6df65e4027afb30801cd99f79a, keycount=1000, bloomtype=ROW, size=191.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878806007 2023-03-14 14:54:17,651 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting 8e85897b033b4a8689385cad0793eece, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621206007 2023-03-14 14:54:17,651 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting e940b330521141aaa8ab5c770a193979_SeqId_47_, keycount=1002, bloomtype=ROW, size=191.8 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878806007 2023-03-14 14:54:17,652 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-14 14:54:17,652 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 14:54:17,654 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015113078c96ac03ab44d7fbff6c18c27020c47 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015113078c96ac03ab44d7fbff6c18c27020c47 2023-03-14 14:54:17,655 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201ff038e183d684019a026b02a2cd060b5 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201ff038e183d684019a026b02a2cd060b5 2023-03-14 14:54:17,655 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205fe0aa583990d45b092f81bd65d45ddae to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205fe0aa583990d45b092f81bd65d45ddae 2023-03-14 14:54:17,655 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 3 expired mob files are deleted 2023-03-14 14:54:17,656 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-03-14 14:54:17,656 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-14 14:54:17,656 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-14 14:54:17,656 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-14 14:54:17,657 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=42, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-14 14:54:17,658 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 1.8260 sec 2023-03-14 14:54:17,665 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] throttle.PressureAwareThroughputController(145): b108573ed4edc7c6723ae22ab3b01c14#family1#compaction#62 average throughput is 25.80 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 80.77 MB/second 2023-03-14 14:54:17,722 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/10071c4592af47af8445268934c35535, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/fe2a38706eae490c8ec3c0ff2186e78f, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/672ffcbc740147b1bd0a76d470456be6, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/a0a88e5f62974e75badcec7a63c283ea, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/496516398e5d46589bf91dec2e6c08e5, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/7025e6a3a54445a09820550b3ca9ead4, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/4e8b1a150f614390bd128d6805d2db91, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/371ee9fc68c54628bd601993a76bbcd0, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/12c726c6e81240bbb22e318ac9844305, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/dd82080a70bd4f0484cc26dea87353f7_SeqId_44_] to archive 2023-03-14 14:54:17,723 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 14:54:17,725 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/10071c4592af47af8445268934c35535 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/10071c4592af47af8445268934c35535 2023-03-14 14:54:17,726 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/fe2a38706eae490c8ec3c0ff2186e78f to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/fe2a38706eae490c8ec3c0ff2186e78f 2023-03-14 14:54:17,727 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/672ffcbc740147b1bd0a76d470456be6 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/672ffcbc740147b1bd0a76d470456be6 2023-03-14 14:54:17,729 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/a0a88e5f62974e75badcec7a63c283ea to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/a0a88e5f62974e75badcec7a63c283ea 2023-03-14 14:54:17,730 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/496516398e5d46589bf91dec2e6c08e5 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/496516398e5d46589bf91dec2e6c08e5 2023-03-14 14:54:17,732 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/7025e6a3a54445a09820550b3ca9ead4 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/7025e6a3a54445a09820550b3ca9ead4 2023-03-14 14:54:17,734 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/4e8b1a150f614390bd128d6805d2db91 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/4e8b1a150f614390bd128d6805d2db91 2023-03-14 14:54:17,735 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/371ee9fc68c54628bd601993a76bbcd0 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/371ee9fc68c54628bd601993a76bbcd0 2023-03-14 14:54:17,736 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/12c726c6e81240bbb22e318ac9844305 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/12c726c6e81240bbb22e318ac9844305 2023-03-14 14:54:17,737 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/dd82080a70bd4f0484cc26dea87353f7_SeqId_44_ to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/dd82080a70bd4f0484cc26dea87353f7_SeqId_44_ 2023-03-14 14:54:17,737 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.HMaster$12(2454): Client=jenkins//148.251.75.209 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-03-14 14:54:17,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure2.ProcedureExecutor(1029): Stored pid=43, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:18,146 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-03-14 14:54:18,147 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-03-14 14:54:18,147 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-03-14 14:54:18,150 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=43, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-03-14 14:54:18,152 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=b108573ed4edc7c6723ae22ab3b01c14, REOPEN/MOVE}] 2023-03-14 14:54:18,153 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=b108573ed4edc7c6723ae22ab3b01c14, REOPEN/MOVE 2023-03-14 14:54:18,154 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=b108573ed4edc7c6723ae22ab3b01c14, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:18,154 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1678805658154"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1678805658154"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678805658154"}]},"ts":"1678805658154"} 2023-03-14 14:54:18,155 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=45, state=RUNNABLE; CloseRegionProcedure b108573ed4edc7c6723ae22ab3b01c14, server=jenkins-hbase20.apache.org,41317,1678805580877}] 2023-03-14 14:54:18,307 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close b108573ed4edc7c6723ae22ab3b01c14 2023-03-14 14:54:18,307 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing b108573ed4edc7c6723ae22ab3b01c14, disabling compactions & flushes 2023-03-14 14:54:18,307 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14. 2023-03-14 14:54:18,883 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/.tmp/family1/605f91cebe2142ff8a3c70adf9e22689 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/605f91cebe2142ff8a3c70adf9e22689 2023-03-14 14:54:18,888 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in b108573ed4edc7c6723ae22ab3b01c14/family1 of b108573ed4edc7c6723ae22ab3b01c14 into 605f91cebe2142ff8a3c70adf9e22689(size=193.0 K), total size for store is 193.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-14 14:54:18,888 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for b108573ed4edc7c6723ae22ab3b01c14: 2023-03-14 14:54:18,888 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14. 2023-03-14 14:54:18,888 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14. 2023-03-14 14:54:18,888 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14., storeName=family1, fileCount=3, fileSize=390.1 K (191.4 K, 6.8 K, 191.8 K), priority=2, time=1678805657650; duration=1sec 2023-03-14 14:54:18,888 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14. after waiting 0 ms 2023-03-14 14:54:18,888 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-14 14:54:18,888 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14. 2023-03-14 14:54:18,889 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/3921ea6df65e4027afb30801cd99f79a, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/8e85897b033b4a8689385cad0793eece, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/e940b330521141aaa8ab5c770a193979_SeqId_47_] to archive 2023-03-14 14:54:18,889 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 14:54:18,891 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/3921ea6df65e4027afb30801cd99f79a to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/3921ea6df65e4027afb30801cd99f79a 2023-03-14 14:54:18,892 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/8e85897b033b4a8689385cad0793eece to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/8e85897b033b4a8689385cad0793eece 2023-03-14 14:54:18,893 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/e940b330521141aaa8ab5c770a193979_SeqId_47_ to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/e940b330521141aaa8ab5c770a193979_SeqId_47_ 2023-03-14 14:54:18,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-03-14 14:54:18,899 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14. 2023-03-14 14:54:18,899 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for b108573ed4edc7c6723ae22ab3b01c14: 2023-03-14 14:54:18,899 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(3509): Not adding moved region record: b108573ed4edc7c6723ae22ab3b01c14 to self. 2023-03-14 14:54:18,901 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed b108573ed4edc7c6723ae22ab3b01c14 2023-03-14 14:54:18,901 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=b108573ed4edc7c6723ae22ab3b01c14, regionState=CLOSED 2023-03-14 14:54:18,902 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1678805658901"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678805658901"}]},"ts":"1678805658901"} 2023-03-14 14:54:18,905 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=45 2023-03-14 14:54:18,905 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=45, state=SUCCESS; CloseRegionProcedure b108573ed4edc7c6723ae22ab3b01c14, server=jenkins-hbase20.apache.org,41317,1678805580877 in 748 msec 2023-03-14 14:54:18,905 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=b108573ed4edc7c6723ae22ab3b01c14, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase20.apache.org,41317,1678805580877; forceNewPlan=false, retain=true 2023-03-14 14:54:19,055 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=b108573ed4edc7c6723ae22ab3b01c14, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:19,056 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1678805659055"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1678805659055"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678805659055"}]},"ts":"1678805659055"} 2023-03-14 14:54:19,057 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=45, state=RUNNABLE; OpenRegionProcedure b108573ed4edc7c6723ae22ab3b01c14, server=jenkins-hbase20.apache.org,41317,1678805580877}] 2023-03-14 14:54:19,211 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14. 2023-03-14 14:54:19,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b108573ed4edc7c6723ae22ab3b01c14, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14.', STARTKEY => '', ENDKEY => ''} 2023-03-14 14:54:19,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly b108573ed4edc7c6723ae22ab3b01c14 2023-03-14 14:54:19,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 14:54:19,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for b108573ed4edc7c6723ae22ab3b01c14 2023-03-14 14:54:19,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for b108573ed4edc7c6723ae22ab3b01c14 2023-03-14 14:54:19,212 INFO [StoreOpener-b108573ed4edc7c6723ae22ab3b01c14-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region b108573ed4edc7c6723ae22ab3b01c14 2023-03-14 14:54:19,213 DEBUG [StoreOpener-b108573ed4edc7c6723ae22ab3b01c14-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1 2023-03-14 14:54:19,213 DEBUG [StoreOpener-b108573ed4edc7c6723ae22ab3b01c14-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1 2023-03-14 14:54:19,213 INFO [StoreOpener-b108573ed4edc7c6723ae22ab3b01c14-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b108573ed4edc7c6723ae22ab3b01c14 columnFamilyName family1 2023-03-14 14:54:19,218 DEBUG [StoreOpener-b108573ed4edc7c6723ae22ab3b01c14-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/605f91cebe2142ff8a3c70adf9e22689 2023-03-14 14:54:19,218 INFO [StoreOpener-b108573ed4edc7c6723ae22ab3b01c14-1] regionserver.HStore(310): Store=b108573ed4edc7c6723ae22ab3b01c14/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 14:54:19,219 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14 2023-03-14 14:54:19,221 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14 2023-03-14 14:54:19,224 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for b108573ed4edc7c6723ae22ab3b01c14 2023-03-14 14:54:19,224 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened b108573ed4edc7c6723ae22ab3b01c14; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74495742, jitterRate=0.11007305979728699}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-14 14:54:19,224 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for b108573ed4edc7c6723ae22ab3b01c14: 2023-03-14 14:54:19,225 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14., pid=47, masterSystemTime=1678805659208 2023-03-14 14:54:19,227 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14. 2023-03-14 14:54:19,227 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14. 2023-03-14 14:54:19,227 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=b108573ed4edc7c6723ae22ab3b01c14, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:19,227 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1678805659227"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1678805659227"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678805659227"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678805659227"}]},"ts":"1678805659227"} 2023-03-14 14:54:19,230 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=45 2023-03-14 14:54:19,230 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=45, state=SUCCESS; OpenRegionProcedure b108573ed4edc7c6723ae22ab3b01c14, server=jenkins-hbase20.apache.org,41317,1678805580877 in 171 msec 2023-03-14 14:54:19,231 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-03-14 14:54:19,231 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=b108573ed4edc7c6723ae22ab3b01c14, REOPEN/MOVE in 1.0780 sec 2023-03-14 14:54:19,233 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=43 2023-03-14 14:54:19,233 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=43, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.0820 sec 2023-03-14 14:54:19,235 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=43, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.4970 sec 2023-03-14 14:54:19,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=43 2023-03-14 14:54:19,237 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(278): alter status finished 2023-03-14 14:54:19,238 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=38031] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:19,239 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-14 14:54:19,240 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-14 14:54:19,240 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-14 14:54:19,240 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678806259240 2023-03-14 14:54:19,241 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-14 14:54:19,242 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-03-14 14:54:19,242 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-14 14:54:19,242 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] zookeeper.ReadOnlyZKClient(139): Connect 0x7e675d83 to 127.0.0.1:50211 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-14 14:54:19,245 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2007c950, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-14 14:54:19,245 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-14 14:54:19,246 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-14 14:54:19,246 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-14 14:54:19,246 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-14 14:54:19,246 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-14 14:54:19,674 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128dc59dd8daf1d41e989204e93a5f05648 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128dc59dd8daf1d41e989204e93a5f05648 2023-03-14 14:54:19,675 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-14 14:54:19,686 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-14 14:54:19,687 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:45362, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-14 14:54:19,694 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-14 14:54:19,699 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:57614, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-14 14:54:19,709 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/f127a28b61b54d2e9c359099be8b1ed4 first=Optional[r05] last=Optional[r8] 2023-03-14 14:54:19,710 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14., hostname=jenkins-hbase20.apache.org,41317,1678805580877, seqNum=51 for row with hfile group [{family1,hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/f127a28b61b54d2e9c359099be8b1ed4}] 2023-03-14 14:54:19,717 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/f127a28b61b54d2e9c359099be8b1ed4 for inclusion in b108573ed4edc7c6723ae22ab3b01c14/family1 2023-03-14 14:54:19,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-03-14 14:54:19,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(777): Region bounds: first= last= 2023-03-14 14:54:19,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HRegion(2446): Flush status journal for b108573ed4edc7c6723ae22ab3b01c14: 2023-03-14 14:54:19,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/f127a28b61b54d2e9c359099be8b1ed4 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__7huol04fu0delmjieduftgi7tdkdn4hiiv6hijssbvv0mr6bpj1diq1jhjj3a05o/family1/f127a28b61b54d2e9c359099be8b1ed4 2023-03-14 14:54:19,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__7huol04fu0delmjieduftgi7tdkdn4hiiv6hijssbvv0mr6bpj1diq1jhjj3a05o/family1/f127a28b61b54d2e9c359099be8b1ed4 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/39af81b3a49042f992cca993fe8935ff_SeqId_53_ 2023-03-14 14:54:19,727 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__7huol04fu0delmjieduftgi7tdkdn4hiiv6hijssbvv0mr6bpj1diq1jhjj3a05o/family1/f127a28b61b54d2e9c359099be8b1ed4 into b108573ed4edc7c6723ae22ab3b01c14/family1 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/39af81b3a49042f992cca993fe8935ff_SeqId_53_ - updating store file list. 2023-03-14 14:54:19,731 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/39af81b3a49042f992cca993fe8935ff_SeqId_53_ into b108573ed4edc7c6723ae22ab3b01c14/family1 2023-03-14 14:54:19,732 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__7huol04fu0delmjieduftgi7tdkdn4hiiv6hijssbvv0mr6bpj1diq1jhjj3a05o/family1/f127a28b61b54d2e9c359099be8b1ed4 into b108573ed4edc7c6723ae22ab3b01c14/family1 (new location: hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/39af81b3a49042f992cca993fe8935ff_SeqId_53_) 2023-03-14 14:54:19,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__7huol04fu0delmjieduftgi7tdkdn4hiiv6hijssbvv0mr6bpj1diq1jhjj3a05o/family1/f127a28b61b54d2e9c359099be8b1ed4 2023-03-14 14:54:19,736 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-14 14:54:19,737 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 14:54:19,738 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120d1649ed710e5453b9e315ac35877503d to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120d1649ed710e5453b9e315ac35877503d 2023-03-14 14:54:19,739 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511287e33095e26b046ce85e255315113ce65 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511287e33095e26b046ce85e255315113ce65 2023-03-14 14:54:19,739 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2 expired mob files are deleted 2023-03-14 14:54:19,739 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-03-14 14:54:19,740 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-14 14:54:19,740 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-14 14:54:19,740 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-14 14:54:19,740 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-14 14:54:19,740 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-14 14:54:19,741 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-14 14:54:19,743 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 503 msec 2023-03-14 14:54:19,793 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.HMaster$12(2454): Client=jenkins//148.251.75.209 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-03-14 14:54:19,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:20,202 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-03-14 14:54:20,203 DEBUG [PEWorker-4] util.FSTableDescriptors(519): Deleted hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-03-14 14:54:20,203 INFO [PEWorker-4] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-03-14 14:54:20,205 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=49, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-03-14 14:54:20,211 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=b108573ed4edc7c6723ae22ab3b01c14, REOPEN/MOVE}] 2023-03-14 14:54:20,213 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=b108573ed4edc7c6723ae22ab3b01c14, REOPEN/MOVE 2023-03-14 14:54:20,213 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=b108573ed4edc7c6723ae22ab3b01c14, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:20,214 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1678805660213"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1678805660213"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678805660213"}]},"ts":"1678805660213"} 2023-03-14 14:54:20,216 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE; CloseRegionProcedure b108573ed4edc7c6723ae22ab3b01c14, server=jenkins-hbase20.apache.org,41317,1678805580877}] 2023-03-14 14:54:20,369 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close b108573ed4edc7c6723ae22ab3b01c14 2023-03-14 14:54:20,369 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing b108573ed4edc7c6723ae22ab3b01c14, disabling compactions & flushes 2023-03-14 14:54:20,369 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14. 2023-03-14 14:54:20,369 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14. 2023-03-14 14:54:20,369 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14. after waiting 0 ms 2023-03-14 14:54:20,369 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14. 2023-03-14 14:54:20,375 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-03-14 14:54:20,376 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14. 2023-03-14 14:54:20,376 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for b108573ed4edc7c6723ae22ab3b01c14: 2023-03-14 14:54:20,376 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(3509): Not adding moved region record: b108573ed4edc7c6723ae22ab3b01c14 to self. 2023-03-14 14:54:20,378 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed b108573ed4edc7c6723ae22ab3b01c14 2023-03-14 14:54:20,378 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=b108573ed4edc7c6723ae22ab3b01c14, regionState=CLOSED 2023-03-14 14:54:20,378 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1678805660378"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678805660378"}]},"ts":"1678805660378"} 2023-03-14 14:54:20,381 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-03-14 14:54:20,381 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; CloseRegionProcedure b108573ed4edc7c6723ae22ab3b01c14, server=jenkins-hbase20.apache.org,41317,1678805580877 in 163 msec 2023-03-14 14:54:20,381 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=b108573ed4edc7c6723ae22ab3b01c14, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase20.apache.org,41317,1678805580877; forceNewPlan=false, retain=true 2023-03-14 14:54:20,532 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=b108573ed4edc7c6723ae22ab3b01c14, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:20,532 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1678805660532"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1678805660532"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678805660532"}]},"ts":"1678805660532"} 2023-03-14 14:54:20,533 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=51, state=RUNNABLE; OpenRegionProcedure b108573ed4edc7c6723ae22ab3b01c14, server=jenkins-hbase20.apache.org,41317,1678805580877}] 2023-03-14 14:54:20,688 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14. 2023-03-14 14:54:20,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b108573ed4edc7c6723ae22ab3b01c14, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14.', STARTKEY => '', ENDKEY => ''} 2023-03-14 14:54:20,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly b108573ed4edc7c6723ae22ab3b01c14 2023-03-14 14:54:20,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 14:54:20,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for b108573ed4edc7c6723ae22ab3b01c14 2023-03-14 14:54:20,689 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for b108573ed4edc7c6723ae22ab3b01c14 2023-03-14 14:54:20,690 INFO [StoreOpener-b108573ed4edc7c6723ae22ab3b01c14-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region b108573ed4edc7c6723ae22ab3b01c14 2023-03-14 14:54:20,691 DEBUG [StoreOpener-b108573ed4edc7c6723ae22ab3b01c14-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1 2023-03-14 14:54:20,691 DEBUG [StoreOpener-b108573ed4edc7c6723ae22ab3b01c14-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1 2023-03-14 14:54:20,691 INFO [StoreOpener-b108573ed4edc7c6723ae22ab3b01c14-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b108573ed4edc7c6723ae22ab3b01c14 columnFamilyName family1 2023-03-14 14:54:20,697 DEBUG [StoreOpener-b108573ed4edc7c6723ae22ab3b01c14-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/39af81b3a49042f992cca993fe8935ff_SeqId_53_ 2023-03-14 14:54:20,700 DEBUG [StoreOpener-b108573ed4edc7c6723ae22ab3b01c14-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/family1/605f91cebe2142ff8a3c70adf9e22689 2023-03-14 14:54:20,700 INFO [StoreOpener-b108573ed4edc7c6723ae22ab3b01c14-1] regionserver.HStore(310): Store=b108573ed4edc7c6723ae22ab3b01c14/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 14:54:20,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14 2023-03-14 14:54:20,702 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14 2023-03-14 14:54:20,705 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for b108573ed4edc7c6723ae22ab3b01c14 2023-03-14 14:54:20,705 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened b108573ed4edc7c6723ae22ab3b01c14; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63435209, jitterRate=-0.05474172532558441}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-14 14:54:20,705 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for b108573ed4edc7c6723ae22ab3b01c14: 2023-03-14 14:54:20,706 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14., pid=53, masterSystemTime=1678805660685 2023-03-14 14:54:20,707 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14. 2023-03-14 14:54:20,707 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14. 2023-03-14 14:54:20,708 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=b108573ed4edc7c6723ae22ab3b01c14, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:20,708 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1678805660708"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1678805660708"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678805660708"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678805660708"}]},"ts":"1678805660708"} 2023-03-14 14:54:20,711 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-03-14 14:54:20,711 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; OpenRegionProcedure b108573ed4edc7c6723ae22ab3b01c14, server=jenkins-hbase20.apache.org,41317,1678805580877 in 176 msec 2023-03-14 14:54:20,712 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=50 2023-03-14 14:54:20,712 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=50, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=b108573ed4edc7c6723ae22ab3b01c14, REOPEN/MOVE in 500 msec 2023-03-14 14:54:20,713 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=49 2023-03-14 14:54:20,713 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=49, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 507 msec 2023-03-14 14:54:20,715 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 921 msec 2023-03-14 14:54:20,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=49 2023-03-14 14:54:20,717 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(278): alter status finished 2023-03-14 14:54:20,717 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=38031] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-03-14 14:54:20,718 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-14 14:54:20,719 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-14 14:54:20,720 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-14 14:54:20,720 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=54, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678806260720 2023-03-14 14:54:20,721 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-14 14:54:20,721 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-03-14 14:54:20,722 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-14 14:54:20,722 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] zookeeper.ReadOnlyZKClient(139): Connect 0x39529775 to 127.0.0.1:50211 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-14 14:54:20,725 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@27018446, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-14 14:54:20,726 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-14 14:54:20,726 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-14 14:54:20,726 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-14 14:54:20,726 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-14 14:54:20,726 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-14 14:54:20,726 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-14 14:54:20,726 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-14 14:54:20,726 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-03-14 14:54:20,726 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-03-14 14:54:20,726 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-14 14:54:20,727 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=54, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-03-14 14:54:20,729 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 9 msec 2023-03-14 14:54:20,778 INFO [Listener at localhost.localdomain/44261] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=244 (was 257), OpenFileDescriptor=612 (was 620), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=225 (was 242), ProcessCount=170 (was 170), AvailableMemoryMB=12366 (was 12495) 2023-03-14 14:54:20,790 INFO [Listener at localhost.localdomain/44261] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=244, OpenFileDescriptor=612, MaxFileDescriptor=60000, SystemLoadAverage=225, ProcessCount=170, AvailableMemoryMB=12366 2023-03-14 14:54:20,792 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-03-14 14:54:20,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure2.ProcedureExecutor(1029): Stored pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:20,794 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_PRE_OPERATION 2023-03-14 14:54:20,795 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily" procId is: 55 2023-03-14 14:54:20,795 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-14 14:54:20,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-03-14 14:54:20,796 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a 2023-03-14 14:54:20,797 DEBUG [HFileArchiver-10] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a empty. 2023-03-14 14:54:20,797 DEBUG [HFileArchiver-10] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a 2023-03-14 14:54:20,798 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily regions 2023-03-14 14:54:20,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-03-14 14:54:21,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-03-14 14:54:21,206 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-03-14 14:54:21,207 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(7675): creating {ENCODED => 4e01724a8ecff4aa30dbfa9d68c1991a, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp 2023-03-14 14:54:21,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-03-14 14:54:21,642 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 14:54:21,642 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1604): Closing 4e01724a8ecff4aa30dbfa9d68c1991a, disabling compactions & flushes 2023-03-14 14:54:21,642 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a. 2023-03-14 14:54:21,643 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a. 2023-03-14 14:54:21,643 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a. after waiting 0 ms 2023-03-14 14:54:21,643 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a. 2023-03-14 14:54:21,643 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a. 2023-03-14 14:54:21,643 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1558): Region close journal for 4e01724a8ecff4aa30dbfa9d68c1991a: 2023-03-14 14:54:21,649 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ADD_TO_META 2023-03-14 14:54:21,652 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1678805661651"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678805661651"}]},"ts":"1678805661651"} 2023-03-14 14:54:21,654 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-14 14:54:21,655 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-14 14:54:21,655 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678805661655"}]},"ts":"1678805661655"} 2023-03-14 14:54:21,656 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLING in hbase:meta 2023-03-14 14:54:21,659 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=4e01724a8ecff4aa30dbfa9d68c1991a, ASSIGN}] 2023-03-14 14:54:21,660 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=4e01724a8ecff4aa30dbfa9d68c1991a, ASSIGN 2023-03-14 14:54:21,661 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=4e01724a8ecff4aa30dbfa9d68c1991a, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,41317,1678805580877; forceNewPlan=false, retain=false 2023-03-14 14:54:21,812 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=4e01724a8ecff4aa30dbfa9d68c1991a, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:21,813 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1678805661812"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1678805661812"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678805661812"}]},"ts":"1678805661812"} 2023-03-14 14:54:21,816 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=57, ppid=56, state=RUNNABLE; OpenRegionProcedure 4e01724a8ecff4aa30dbfa9d68c1991a, server=jenkins-hbase20.apache.org,41317,1678805580877}] 2023-03-14 14:54:21,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-03-14 14:54:21,972 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a. 2023-03-14 14:54:21,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4e01724a8ecff4aa30dbfa9d68c1991a, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a.', STARTKEY => '', ENDKEY => ''} 2023-03-14 14:54:21,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 4e01724a8ecff4aa30dbfa9d68c1991a 2023-03-14 14:54:21,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 14:54:21,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 4e01724a8ecff4aa30dbfa9d68c1991a 2023-03-14 14:54:21,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 4e01724a8ecff4aa30dbfa9d68c1991a 2023-03-14 14:54:21,975 INFO [StoreOpener-4e01724a8ecff4aa30dbfa9d68c1991a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 4e01724a8ecff4aa30dbfa9d68c1991a 2023-03-14 14:54:21,977 DEBUG [StoreOpener-4e01724a8ecff4aa30dbfa9d68c1991a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1 2023-03-14 14:54:21,977 DEBUG [StoreOpener-4e01724a8ecff4aa30dbfa9d68c1991a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1 2023-03-14 14:54:21,978 INFO [StoreOpener-4e01724a8ecff4aa30dbfa9d68c1991a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4e01724a8ecff4aa30dbfa9d68c1991a columnFamilyName family1 2023-03-14 14:54:21,980 INFO [StoreOpener-4e01724a8ecff4aa30dbfa9d68c1991a-1] regionserver.HStore(310): Store=4e01724a8ecff4aa30dbfa9d68c1991a/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 14:54:21,981 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a 2023-03-14 14:54:21,982 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a 2023-03-14 14:54:21,987 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 4e01724a8ecff4aa30dbfa9d68c1991a 2023-03-14 14:54:21,991 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-14 14:54:21,991 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 4e01724a8ecff4aa30dbfa9d68c1991a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65010726, jitterRate=-0.031264692544937134}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-14 14:54:21,991 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 4e01724a8ecff4aa30dbfa9d68c1991a: 2023-03-14 14:54:21,992 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a., pid=57, masterSystemTime=1678805661969 2023-03-14 14:54:21,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a. 2023-03-14 14:54:21,995 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a. 2023-03-14 14:54:21,996 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=4e01724a8ecff4aa30dbfa9d68c1991a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:21,996 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1678805661995"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1678805661995"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678805661995"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678805661995"}]},"ts":"1678805661995"} 2023-03-14 14:54:22,000 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=57, resume processing ppid=56 2023-03-14 14:54:22,000 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=57, ppid=56, state=SUCCESS; OpenRegionProcedure 4e01724a8ecff4aa30dbfa9d68c1991a, server=jenkins-hbase20.apache.org,41317,1678805580877 in 182 msec 2023-03-14 14:54:22,002 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=56, resume processing ppid=55 2023-03-14 14:54:22,002 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=56, ppid=55, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=4e01724a8ecff4aa30dbfa9d68c1991a, ASSIGN in 341 msec 2023-03-14 14:54:22,002 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-14 14:54:22,002 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678805662002"}]},"ts":"1678805662002"} 2023-03-14 14:54:22,004 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLED in hbase:meta 2023-03-14 14:54:22,006 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_POST_OPERATION 2023-03-14 14:54:22,007 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=55, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.2140 sec 2023-03-14 14:54:22,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-03-14 14:54:22,903 INFO [Listener at localhost.localdomain/44261] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, procId: 55 completed 2023-03-14 14:54:22,929 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:54:22,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:22,930 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-14 14:54:22,930 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:54:22,930 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-14 14:54:22,930 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-14 14:54:22,931 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:22,931 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:22,931 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:22,931 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:54:22,931 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:54:22,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:54:22,932 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:22,932 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:54:22,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:22,932 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:22,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:54:22,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:22,932 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:22,932 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:22,932 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-14 14:54:22,932 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:54:22,932 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-14 14:54:22,933 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 14:54:22,933 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:54:22,933 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a. 2023-03-14 14:54:22,933 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a. started... 2023-03-14 14:54:22,933 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4e01724a8ecff4aa30dbfa9d68c1991a 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-14 14:54:23,365 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130eaa7c5cfba874b85a8c6f719c084ce2c to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130eaa7c5cfba874b85a8c6f719c084ce2c 2023-03-14 14:54:23,770 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/.tmp/family1/cf2fd46ee0ab4278b3a596118e27b4a0 2023-03-14 14:54:23,783 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/.tmp/family1/cf2fd46ee0ab4278b3a596118e27b4a0 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/cf2fd46ee0ab4278b3a596118e27b4a0 2023-03-14 14:54:23,788 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/cf2fd46ee0ab4278b3a596118e27b4a0, entries=1000, sequenceid=5, filesize=190.5 K 2023-03-14 14:54:23,789 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 4e01724a8ecff4aa30dbfa9d68c1991a in 856ms, sequenceid=5, compaction requested=false 2023-03-14 14:54:23,789 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-14 14:54:23,790 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4e01724a8ecff4aa30dbfa9d68c1991a: 2023-03-14 14:54:23,790 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a. 2023-03-14 14:54:23,790 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 14:54:23,790 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 14:54:23,790 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:23,790 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-14 14:54:23,790 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-14 14:54:23,792 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:23,792 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:23,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:23,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:23,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:23,792 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:23,792 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:54:23,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:23,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:23,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:23,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:23,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:23,795 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-14 14:54:23,795 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4aab425[Count = 0] remaining members to acquire global barrier 2023-03-14 14:54:23,795 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-14 14:54:23,795 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:23,796 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:23,796 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:23,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:23,796 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-14 14:54:23,796 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-14 14:54:23,796 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:54:23,796 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:23,796 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:54:23,797 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:23,797 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-14 14:54:23,797 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:54:23,797 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-14 14:54:23,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:23,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:23,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:23,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:23,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:23,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:23,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:23,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:23,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:23,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:23,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:54:23,801 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-14 14:54:23,801 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-14 14:54:23,801 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:54:23,801 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:54:23,801 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:23,801 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:54:23,802 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:23,802 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:23,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:23,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:23,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:23,802 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:23,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:23,802 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:54:23,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:23,803 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:54:23,803 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:23,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:54:23,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:23,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:23,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:23,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:23,804 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:23,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:23,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:23,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:23,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:23,808 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:23,808 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:23,808 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:23,808 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:54:23,808 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:54:23,808 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-14 14:54:23,808 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-14 14:54:23,809 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:54:23,808 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:23,808 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:54:23,808 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:54:23,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:54:23,809 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-14 14:54:23,809 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:54:23,809 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:23,809 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:23,809 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:54:23,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:54:23,809 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:23,909 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:54:23,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:54:23,915 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:54:23,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-14 14:54:23,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:23,916 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-14 14:54:23,916 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:54:23,916 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-14 14:54:23,916 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-14 14:54:23,917 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:23,917 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:23,918 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:54:23,918 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:23,918 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:54:23,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:54:23,918 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:23,918 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:54:23,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:23,918 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:23,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:54:23,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:23,918 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:23,919 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-14 14:54:23,919 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:23,919 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-14 14:54:23,919 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:54:23,919 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-14 14:54:23,919 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 14:54:23,919 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:54:23,919 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a. 2023-03-14 14:54:23,919 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a. started... 2023-03-14 14:54:23,919 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4e01724a8ecff4aa30dbfa9d68c1991a 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-14 14:54:24,343 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128da686e5ae99e41d6addcba09bea21e69 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128da686e5ae99e41d6addcba09bea21e69 2023-03-14 14:54:24,348 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/.tmp/family1/2fe14625c3d64eba92454aaf9f71a917 2023-03-14 14:54:24,352 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/.tmp/family1/2fe14625c3d64eba92454aaf9f71a917 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/2fe14625c3d64eba92454aaf9f71a917 2023-03-14 14:54:24,356 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/2fe14625c3d64eba92454aaf9f71a917, entries=1, sequenceid=9, filesize=5.0 K 2023-03-14 14:54:24,356 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 4e01724a8ecff4aa30dbfa9d68c1991a in 437ms, sequenceid=9, compaction requested=false 2023-03-14 14:54:24,357 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4e01724a8ecff4aa30dbfa9d68c1991a: 2023-03-14 14:54:24,357 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a. 2023-03-14 14:54:24,357 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 14:54:24,357 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 14:54:24,357 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:24,357 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-14 14:54:24,357 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-14 14:54:24,358 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:24,358 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:24,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:24,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:24,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:24,358 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:24,358 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:54:24,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:24,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:24,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:24,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:24,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:24,359 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-14 14:54:24,359 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@225a63bb[Count = 0] remaining members to acquire global barrier 2023-03-14 14:54:24,359 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-14 14:54:24,359 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:24,359 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:24,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:24,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:24,360 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-14 14:54:24,360 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-14 14:54:24,360 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:24,360 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:54:24,360 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:54:24,360 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:24,360 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-14 14:54:24,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:24,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:24,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:24,360 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:54:24,360 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-14 14:54:24,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:24,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:24,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:24,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:24,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:24,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:24,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:24,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:54:24,362 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-14 14:54:24,362 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-14 14:54:24,362 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:54:24,362 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:54:24,362 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:24,362 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:54:24,363 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:24,363 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:24,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:24,363 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:54:24,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:24,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:24,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:24,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:24,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:54:24,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:54:24,364 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:24,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:24,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:24,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:24,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:24,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:24,364 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:24,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:24,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:24,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:24,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:24,366 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:24,366 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:24,366 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:54:24,366 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:24,366 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-14 14:54:24,366 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:54:24,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:54:24,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:54:24,366 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:54:24,366 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:54:24,366 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-14 14:54:24,366 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-14 14:54:24,366 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:24,366 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:54:24,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:54:24,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:54:24,366 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:24,366 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:24,366 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:24,438 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-14 14:54:24,466 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:54:24,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:54:24,471 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:54:24,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-14 14:54:24,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:24,472 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-14 14:54:24,472 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:54:24,472 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-14 14:54:24,472 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-14 14:54:24,473 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:24,473 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:24,474 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:54:24,474 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:54:24,474 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:24,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:54:24,474 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:24,474 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:54:24,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:24,474 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:24,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:54:24,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:24,475 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:24,475 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-14 14:54:24,475 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:24,475 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-14 14:54:24,475 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:54:24,475 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-14 14:54:24,476 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 14:54:24,476 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:54:24,476 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a. 2023-03-14 14:54:24,476 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a. started... 2023-03-14 14:54:24,476 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4e01724a8ecff4aa30dbfa9d68c1991a 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 14:54:24,898 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512013199a4d5bede4fa9a96ddd261cf7995f to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512013199a4d5bede4fa9a96ddd261cf7995f 2023-03-14 14:54:25,305 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/.tmp/family1/cd747496f7de4ee2b532ad6225968467 2023-03-14 14:54:25,316 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/.tmp/family1/cd747496f7de4ee2b532ad6225968467 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/cd747496f7de4ee2b532ad6225968467 2023-03-14 14:54:25,323 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/cd747496f7de4ee2b532ad6225968467, entries=1, sequenceid=13, filesize=5.0 K 2023-03-14 14:54:25,324 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4e01724a8ecff4aa30dbfa9d68c1991a in 848ms, sequenceid=13, compaction requested=true 2023-03-14 14:54:25,324 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4e01724a8ecff4aa30dbfa9d68c1991a: 2023-03-14 14:54:25,324 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a. 2023-03-14 14:54:25,324 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 14:54:25,324 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 14:54:25,324 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:25,324 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-14 14:54:25,324 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-14 14:54:25,326 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:25,326 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:25,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:25,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:25,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:25,326 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:25,326 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:54:25,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:25,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:25,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:25,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:25,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:25,328 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-14 14:54:25,328 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2d6d0e4e[Count = 0] remaining members to acquire global barrier 2023-03-14 14:54:25,328 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-14 14:54:25,328 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:25,329 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:25,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:25,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:25,329 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-14 14:54:25,329 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-14 14:54:25,330 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:25,330 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:54:25,330 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:54:25,330 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:25,330 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-14 14:54:25,330 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:54:25,331 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-14 14:54:25,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:25,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:25,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:25,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:25,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:25,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:25,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:25,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:25,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:25,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:25,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:54:25,332 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-14 14:54:25,332 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-14 14:54:25,333 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:54:25,333 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:54:25,333 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:25,333 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:54:25,333 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:25,333 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:25,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:25,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:25,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:25,334 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:54:25,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:25,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:25,334 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:25,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:54:25,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:54:25,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:25,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:25,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:25,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:25,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:25,335 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:25,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:25,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:25,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:25,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:25,336 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:25,336 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:25,336 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:54:25,336 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:54:25,336 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:25,336 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:54:25,336 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-14 14:54:25,337 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:54:25,336 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:54:25,337 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-14 14:54:25,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:54:25,336 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:25,337 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:25,337 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-14 14:54:25,337 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:25,337 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:54:25,337 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:25,337 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:54:25,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:54:25,437 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:54:25,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:54:25,441 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:54:25,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-14 14:54:25,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:25,442 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-14 14:54:25,442 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:54:25,442 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-14 14:54:25,442 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-14 14:54:25,443 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:25,443 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:25,444 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:54:25,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:54:25,444 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:25,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:54:25,444 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:25,444 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:54:25,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:25,445 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:25,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:54:25,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:25,445 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:25,445 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-14 14:54:25,445 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:25,445 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-14 14:54:25,445 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:54:25,445 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-14 14:54:25,446 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 14:54:25,446 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:54:25,446 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a. 2023-03-14 14:54:25,446 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a. started... 2023-03-14 14:54:25,446 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4e01724a8ecff4aa30dbfa9d68c1991a 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 14:54:25,866 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512058cb86bac054d4c8084770ffc2c53292f to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512058cb86bac054d4c8084770ffc2c53292f 2023-03-14 14:54:26,274 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/.tmp/family1/3808f41c705749218e36670707ac68b2 2023-03-14 14:54:26,286 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/.tmp/family1/3808f41c705749218e36670707ac68b2 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/3808f41c705749218e36670707ac68b2 2023-03-14 14:54:26,291 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/3808f41c705749218e36670707ac68b2, entries=1, sequenceid=17, filesize=5.0 K 2023-03-14 14:54:26,292 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4e01724a8ecff4aa30dbfa9d68c1991a in 846ms, sequenceid=17, compaction requested=true 2023-03-14 14:54:26,292 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4e01724a8ecff4aa30dbfa9d68c1991a: 2023-03-14 14:54:26,292 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a. 2023-03-14 14:54:26,292 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 14:54:26,292 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 14:54:26,292 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:26,292 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-14 14:54:26,292 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-14 14:54:26,294 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:26,294 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:26,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:26,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:26,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:26,295 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:26,295 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:54:26,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:26,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:26,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:26,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:26,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:26,297 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-14 14:54:26,297 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@78f47b3e[Count = 0] remaining members to acquire global barrier 2023-03-14 14:54:26,297 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-14 14:54:26,297 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:26,297 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:26,297 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:26,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:26,298 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-14 14:54:26,298 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-14 14:54:26,298 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:26,298 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:54:26,298 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:54:26,299 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:26,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:26,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:26,299 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-14 14:54:26,299 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:54:26,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:26,299 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-14 14:54:26,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:26,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:26,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:26,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:26,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:26,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:26,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:26,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:54:26,302 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-14 14:54:26,302 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-14 14:54:26,302 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:54:26,302 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:54:26,302 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:26,302 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:54:26,303 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:26,303 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:26,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:26,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:26,303 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:26,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:26,303 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:54:26,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:26,303 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:26,304 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:54:26,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:54:26,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:26,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:26,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:26,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:26,305 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:26,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:26,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:26,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:26,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:26,306 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:26,306 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:54:26,306 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:26,306 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:54:26,306 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:54:26,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:54:26,306 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:54:26,306 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-14 14:54:26,307 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:54:26,306 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:26,307 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-14 14:54:26,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:54:26,307 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:26,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:54:26,307 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-14 14:54:26,307 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:26,307 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:54:26,307 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:26,307 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:26,407 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:54:26,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:54:26,412 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:54:26,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-14 14:54:26,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:26,413 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-14 14:54:26,414 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:54:26,414 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-14 14:54:26,414 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-14 14:54:26,414 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:26,414 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:26,415 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:26,415 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:54:26,415 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:54:26,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:54:26,416 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:26,416 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:54:26,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:26,416 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:26,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:54:26,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:26,417 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:26,417 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-14 14:54:26,417 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:26,417 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-14 14:54:26,417 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:54:26,417 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-14 14:54:26,417 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 14:54:26,417 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:54:26,418 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a. 2023-03-14 14:54:26,418 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a. started... 2023-03-14 14:54:26,418 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4e01724a8ecff4aa30dbfa9d68c1991a 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 14:54:26,839 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512285908b0e0d9eb40509d3f374b3ca77744 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512285908b0e0d9eb40509d3f374b3ca77744 2023-03-14 14:54:27,247 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/.tmp/family1/aee678a2fb494369b878eba81bbdf8f7 2023-03-14 14:54:27,260 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/.tmp/family1/aee678a2fb494369b878eba81bbdf8f7 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/aee678a2fb494369b878eba81bbdf8f7 2023-03-14 14:54:27,266 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/aee678a2fb494369b878eba81bbdf8f7, entries=1, sequenceid=21, filesize=5.0 K 2023-03-14 14:54:27,267 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4e01724a8ecff4aa30dbfa9d68c1991a in 849ms, sequenceid=21, compaction requested=true 2023-03-14 14:54:27,267 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4e01724a8ecff4aa30dbfa9d68c1991a: 2023-03-14 14:54:27,267 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a. 2023-03-14 14:54:27,267 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 14:54:27,268 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 14:54:27,268 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:27,268 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-14 14:54:27,268 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-14 14:54:27,269 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:27,269 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:27,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:27,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:27,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:27,269 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:27,269 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:54:27,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:27,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:27,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:27,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:27,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:27,270 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-14 14:54:27,270 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@292ef399[Count = 0] remaining members to acquire global barrier 2023-03-14 14:54:27,270 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-14 14:54:27,271 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:27,271 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:27,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:27,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:27,271 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-14 14:54:27,271 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-14 14:54:27,271 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:54:27,271 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:27,271 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:54:27,272 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-14 14:54:27,272 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:54:27,272 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:27,272 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-14 14:54:27,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:27,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:27,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:27,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:27,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:27,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:27,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:27,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:27,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:27,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:27,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:54:27,274 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-14 14:54:27,274 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-14 14:54:27,274 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:54:27,274 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:54:27,274 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:27,274 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:54:27,275 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:27,275 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:27,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:27,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:27,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:27,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:27,275 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:54:27,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:27,276 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:27,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:27,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:54:27,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:54:27,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:27,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:27,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:27,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:27,277 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:27,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:27,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:27,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:27,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:27,278 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:27,278 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:54:27,278 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:27,278 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-14 14:54:27,278 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:27,278 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-14 14:54:27,278 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:54:27,278 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:54:27,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:54:27,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:54:27,278 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:54:27,278 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:27,279 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:27,279 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:27,279 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-14 14:54:27,279 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:27,279 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:54:27,279 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:54:27,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:54:27,379 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:54:27,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:54:27,383 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:54:27,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-14 14:54:27,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:27,385 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-14 14:54:27,385 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:54:27,385 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-14 14:54:27,385 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-14 14:54:27,385 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:27,386 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:27,386 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:54:27,387 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:27,387 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:54:27,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:54:27,387 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:27,387 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:54:27,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:27,388 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:27,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:54:27,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:27,389 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:27,389 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-14 14:54:27,389 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:27,389 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-14 14:54:27,389 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:54:27,389 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-14 14:54:27,389 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 14:54:27,389 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:54:27,389 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a. 2023-03-14 14:54:27,389 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a. started... 2023-03-14 14:54:27,389 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4e01724a8ecff4aa30dbfa9d68c1991a 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 14:54:27,812 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512318e845a7898b34013b2675dab26c576b4 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512318e845a7898b34013b2675dab26c576b4 2023-03-14 14:54:28,221 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/.tmp/family1/cea9a8b6b5ed45beafe2cb0a90a9b172 2023-03-14 14:54:28,232 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/.tmp/family1/cea9a8b6b5ed45beafe2cb0a90a9b172 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/cea9a8b6b5ed45beafe2cb0a90a9b172 2023-03-14 14:54:28,237 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/cea9a8b6b5ed45beafe2cb0a90a9b172, entries=1, sequenceid=25, filesize=5.0 K 2023-03-14 14:54:28,238 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4e01724a8ecff4aa30dbfa9d68c1991a in 849ms, sequenceid=25, compaction requested=true 2023-03-14 14:54:28,238 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4e01724a8ecff4aa30dbfa9d68c1991a: 2023-03-14 14:54:28,238 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a. 2023-03-14 14:54:28,238 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 14:54:28,238 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 14:54:28,238 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:28,238 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-14 14:54:28,238 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-14 14:54:28,239 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:28,239 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:28,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:28,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:28,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:28,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:28,240 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:28,240 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:54:28,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:28,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:28,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:28,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:28,241 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-14 14:54:28,241 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-14 14:54:28,241 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@58980abc[Count = 0] remaining members to acquire global barrier 2023-03-14 14:54:28,241 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:28,242 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:28,242 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:28,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:28,242 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-14 14:54:28,242 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:28,242 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:54:28,242 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-14 14:54:28,242 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:54:28,243 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:28,243 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-14 14:54:28,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:28,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:28,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:28,243 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:54:28,243 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-14 14:54:28,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:28,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:28,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:28,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:28,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:28,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:28,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:28,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:54:28,245 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-14 14:54:28,245 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-14 14:54:28,245 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:54:28,245 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:54:28,245 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:28,245 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:54:28,247 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:28,247 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:28,247 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:28,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:28,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:28,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:28,247 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:54:28,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:28,247 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:28,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:28,247 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:54:28,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:54:28,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:28,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:28,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:28,248 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:28,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:28,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:28,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:28,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:28,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:28,250 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:28,250 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:54:28,250 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:28,250 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:54:28,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:54:28,250 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-14 14:54:28,250 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:54:28,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:54:28,251 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-14 14:54:28,250 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:54:28,251 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-14 14:54:28,250 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:28,251 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:54:28,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:54:28,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:54:28,251 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:28,251 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:28,251 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:28,251 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:28,351 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:54:28,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:54:28,355 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:54:28,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-14 14:54:28,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:28,357 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-14 14:54:28,357 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:54:28,357 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-14 14:54:28,357 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-14 14:54:28,357 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:28,357 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:28,358 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:28,358 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:54:28,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:54:28,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:54:28,358 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:28,358 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:54:28,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:28,358 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:28,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:54:28,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:28,359 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:28,359 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-14 14:54:28,359 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:28,359 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-14 14:54:28,359 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:54:28,359 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-14 14:54:28,359 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 14:54:28,359 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:54:28,359 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a. 2023-03-14 14:54:28,359 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a. started... 2023-03-14 14:54:28,359 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4e01724a8ecff4aa30dbfa9d68c1991a 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 14:54:28,775 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101033e725254de422586c674e06763712b to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101033e725254de422586c674e06763712b 2023-03-14 14:54:29,182 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/.tmp/family1/7f44fd62e3c14be1b0b56db1f0937cad 2023-03-14 14:54:29,193 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/.tmp/family1/7f44fd62e3c14be1b0b56db1f0937cad as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/7f44fd62e3c14be1b0b56db1f0937cad 2023-03-14 14:54:29,198 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/7f44fd62e3c14be1b0b56db1f0937cad, entries=1, sequenceid=29, filesize=5.0 K 2023-03-14 14:54:29,199 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4e01724a8ecff4aa30dbfa9d68c1991a in 840ms, sequenceid=29, compaction requested=true 2023-03-14 14:54:29,199 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4e01724a8ecff4aa30dbfa9d68c1991a: 2023-03-14 14:54:29,199 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a. 2023-03-14 14:54:29,199 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 14:54:29,199 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 14:54:29,199 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:29,199 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-14 14:54:29,199 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-14 14:54:29,200 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:29,200 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:29,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:29,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:29,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:29,201 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:29,201 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:54:29,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:29,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:29,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:29,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:29,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:29,202 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-14 14:54:29,202 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1d42709f[Count = 0] remaining members to acquire global barrier 2023-03-14 14:54:29,202 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-14 14:54:29,202 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:29,203 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:29,203 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:29,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:29,203 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-14 14:54:29,203 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-14 14:54:29,203 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:54:29,203 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:29,203 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:54:29,204 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-14 14:54:29,204 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:54:29,204 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:29,204 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-14 14:54:29,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:29,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:29,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:29,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:29,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:29,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:29,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:29,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:29,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:29,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:29,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:54:29,207 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-14 14:54:29,207 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-14 14:54:29,207 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:54:29,207 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:54:29,207 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:29,207 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:54:29,208 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:29,208 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:29,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:29,208 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:54:29,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:29,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:29,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:29,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:29,209 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:54:29,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:54:29,209 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:29,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:29,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:29,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:29,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:29,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:29,209 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:29,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:29,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:29,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:29,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:29,211 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:29,211 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:54:29,211 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:29,211 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:54:29,211 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-14 14:54:29,211 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:54:29,211 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:54:29,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:54:29,211 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-14 14:54:29,211 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:54:29,211 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:29,211 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:29,211 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:29,211 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-14 14:54:29,211 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:29,211 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:54:29,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:54:29,211 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:54:29,211 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:29,311 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:54:29,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:54:29,320 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:54:29,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-14 14:54:29,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:29,323 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-14 14:54:29,323 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:54:29,323 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-14 14:54:29,323 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-14 14:54:29,323 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:29,323 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:29,324 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:54:29,324 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:29,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:54:29,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:54:29,324 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:29,324 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:54:29,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:29,325 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:29,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:54:29,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:29,325 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:29,325 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-14 14:54:29,325 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:29,325 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-14 14:54:29,325 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:54:29,325 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-14 14:54:29,326 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 14:54:29,326 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:54:29,326 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a. 2023-03-14 14:54:29,326 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a. started... 2023-03-14 14:54:29,326 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4e01724a8ecff4aa30dbfa9d68c1991a 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 14:54:29,746 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103ba8e276db5c84d35b444de421573a934 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103ba8e276db5c84d35b444de421573a934 2023-03-14 14:54:29,754 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/.tmp/family1/885e03faafba4fdb8ec1480bc3ae361f 2023-03-14 14:54:29,760 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/.tmp/family1/885e03faafba4fdb8ec1480bc3ae361f as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/885e03faafba4fdb8ec1480bc3ae361f 2023-03-14 14:54:29,764 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/885e03faafba4fdb8ec1480bc3ae361f, entries=1, sequenceid=33, filesize=5.0 K 2023-03-14 14:54:29,765 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4e01724a8ecff4aa30dbfa9d68c1991a in 439ms, sequenceid=33, compaction requested=true 2023-03-14 14:54:29,765 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4e01724a8ecff4aa30dbfa9d68c1991a: 2023-03-14 14:54:29,765 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a. 2023-03-14 14:54:29,765 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 14:54:29,765 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 14:54:29,765 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:29,765 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-14 14:54:29,765 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-14 14:54:29,766 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:29,766 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:29,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:29,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:29,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:29,767 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:29,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:29,767 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:54:29,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:29,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:29,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:29,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:29,768 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-14 14:54:29,768 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4634d582[Count = 0] remaining members to acquire global barrier 2023-03-14 14:54:29,768 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-14 14:54:29,768 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:29,769 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:29,769 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:29,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:29,769 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-14 14:54:29,769 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-14 14:54:29,769 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:29,769 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:54:29,769 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:54:29,770 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-14 14:54:29,770 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:54:29,770 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-14 14:54:29,770 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:29,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:29,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:29,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:29,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:29,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:29,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:29,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:29,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:29,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:29,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:29,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:54:29,772 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-14 14:54:29,772 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-14 14:54:29,772 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:54:29,772 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:54:29,772 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:29,772 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:54:29,773 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:29,773 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:29,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:29,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:29,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:29,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:29,773 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:54:29,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:29,773 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:29,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:54:29,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:54:29,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:29,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:29,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:29,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:29,774 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:29,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:29,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:29,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:29,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:29,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:29,776 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:29,776 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:29,776 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:29,776 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:29,776 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:54:29,776 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:54:29,776 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-14 14:54:29,776 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:54:29,776 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:29,776 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:54:29,776 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-14 14:54:29,776 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:54:29,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:54:29,776 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:29,777 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-14 14:54:29,777 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:29,777 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:54:29,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:54:29,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:54:29,877 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:54:29,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:54:29,887 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:54:29,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-14 14:54:29,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:29,889 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-14 14:54:29,889 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:54:29,890 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-14 14:54:29,890 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-14 14:54:29,890 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:29,890 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:29,891 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:54:29,891 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:29,891 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:54:29,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:54:29,891 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:29,891 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:54:29,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:29,891 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:29,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:54:29,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:29,892 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:29,892 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-14 14:54:29,892 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:29,892 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-14 14:54:29,892 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:54:29,892 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-14 14:54:29,898 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 14:54:29,898 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:54:29,898 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a. 2023-03-14 14:54:29,898 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a. started... 2023-03-14 14:54:29,898 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4e01724a8ecff4aa30dbfa9d68c1991a 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 14:54:30,320 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015090722439cbae5464d7595950692707d8c80 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015090722439cbae5464d7595950692707d8c80 2023-03-14 14:54:30,725 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/.tmp/family1/d94da5f6f2204adbbf065c2512da63d4 2023-03-14 14:54:30,732 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/.tmp/family1/d94da5f6f2204adbbf065c2512da63d4 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/d94da5f6f2204adbbf065c2512da63d4 2023-03-14 14:54:30,736 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/d94da5f6f2204adbbf065c2512da63d4, entries=1, sequenceid=37, filesize=5.0 K 2023-03-14 14:54:30,737 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4e01724a8ecff4aa30dbfa9d68c1991a in 839ms, sequenceid=37, compaction requested=true 2023-03-14 14:54:30,737 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4e01724a8ecff4aa30dbfa9d68c1991a: 2023-03-14 14:54:30,737 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a. 2023-03-14 14:54:30,737 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 14:54:30,737 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 14:54:30,737 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:30,737 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-14 14:54:30,737 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-14 14:54:30,738 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:30,738 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:30,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:30,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:30,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:30,738 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:30,738 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:54:30,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:30,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:30,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:30,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:30,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:30,739 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-14 14:54:30,739 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@18d854e6[Count = 0] remaining members to acquire global barrier 2023-03-14 14:54:30,739 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-14 14:54:30,740 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:30,740 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:30,740 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:30,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:30,740 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-14 14:54:30,740 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-14 14:54:30,740 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:30,740 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:54:30,740 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:54:30,741 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:30,741 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-14 14:54:30,741 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:54:30,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:30,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:30,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:30,741 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-14 14:54:30,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:30,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:30,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:30,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:30,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:30,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:30,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:30,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:54:30,743 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-14 14:54:30,743 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-14 14:54:30,743 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:54:30,743 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:54:30,743 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:30,743 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:54:30,743 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:30,743 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:30,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:30,744 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:30,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:30,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:30,744 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:54:30,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:30,744 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:30,744 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:54:30,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:30,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:54:30,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:30,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:30,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:30,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:30,745 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:30,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:30,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:30,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:30,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:30,746 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:30,746 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:54:30,746 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:30,746 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:54:30,746 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:30,746 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:54:30,746 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:54:30,746 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-14 14:54:30,746 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:30,746 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-14 14:54:30,746 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:54:30,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:54:30,746 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:30,746 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:30,746 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-14 14:54:30,746 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:54:30,746 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:30,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:54:30,747 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:54:30,847 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:54:30,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:54:30,851 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:54:30,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-03-14 14:54:30,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:30,853 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-14 14:54:30,853 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:54:30,853 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-03-14 14:54:30,853 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-03-14 14:54:30,853 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:30,853 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:30,854 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:30,854 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:54:30,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:54:30,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:54:30,854 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:30,854 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:54:30,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:30,855 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:30,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:54:30,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:30,855 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:30,855 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-03-14 14:54:30,855 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:30,855 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-03-14 14:54:30,855 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:54:30,855 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-03-14 14:54:30,856 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 14:54:30,856 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:54:30,856 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a. 2023-03-14 14:54:30,856 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a. started... 2023-03-14 14:54:30,856 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4e01724a8ecff4aa30dbfa9d68c1991a 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 14:54:31,277 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511200354d6bd62614b97a4e8cfffd6785cf7 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511200354d6bd62614b97a4e8cfffd6785cf7 2023-03-14 14:54:31,685 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/.tmp/family1/32b66643cf28405eaf9e4a3f28f9a3e4 2023-03-14 14:54:31,695 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/.tmp/family1/32b66643cf28405eaf9e4a3f28f9a3e4 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/32b66643cf28405eaf9e4a3f28f9a3e4 2023-03-14 14:54:31,701 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/32b66643cf28405eaf9e4a3f28f9a3e4, entries=1, sequenceid=41, filesize=5.0 K 2023-03-14 14:54:31,702 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4e01724a8ecff4aa30dbfa9d68c1991a in 846ms, sequenceid=41, compaction requested=true 2023-03-14 14:54:31,702 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4e01724a8ecff4aa30dbfa9d68c1991a: 2023-03-14 14:54:31,702 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a. 2023-03-14 14:54:31,702 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 14:54:31,702 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 14:54:31,702 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:31,702 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-03-14 14:54:31,702 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-03-14 14:54:31,704 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:31,704 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:31,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:31,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:31,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:31,704 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:31,704 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:54:31,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:31,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:31,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:31,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:31,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:31,706 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-03-14 14:54:31,706 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@d70ab[Count = 0] remaining members to acquire global barrier 2023-03-14 14:54:31,706 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-03-14 14:54:31,706 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:31,706 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:31,707 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:31,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:31,707 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-03-14 14:54:31,707 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-03-14 14:54:31,707 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:54:31,707 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:31,707 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:54:31,708 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:31,708 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-03-14 14:54:31,708 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:54:31,708 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-03-14 14:54:31,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:31,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:31,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:31,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:31,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:31,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:31,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:31,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:31,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:31,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:31,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:54:31,711 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-03-14 14:54:31,711 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-03-14 14:54:31,711 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:54:31,711 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:54:31,711 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:31,711 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:54:31,712 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:31,712 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:31,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:31,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:31,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:31,713 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:31,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:31,713 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:54:31,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:31,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:54:31,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:54:31,714 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:31,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:31,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:31,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:31,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:31,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:31,715 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:31,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:31,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:31,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:31,720 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:31,720 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:31,720 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:31,720 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:54:31,720 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-03-14 14:54:31,720 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:54:31,720 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:54:31,720 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:54:31,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:54:31,720 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:31,720 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-03-14 14:54:31,721 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:54:31,721 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:31,721 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:31,721 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:31,721 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-03-14 14:54:31,721 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:54:31,721 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:54:31,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:54:31,821 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:54:31,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:54:31,824 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=38031] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:31,826 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] procedure2.ProcedureExecutor(1029): Stored pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-14 14:54:31,827 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-14 14:54:31,828 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=58, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678806271828 2023-03-14 14:54:31,828 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-14 14:54:31,829 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-14 14:54:31,831 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-03-14 14:54:31,832 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-14 14:54:31,832 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] zookeeper.ReadOnlyZKClient(139): Connect 0x6cf09fe5 to 127.0.0.1:50211 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-14 14:54:31,838 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2442dfcf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-14 14:54:31,839 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-14 14:54:32,690 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103fef9cb206d5940bba7c6c6cda7354bbb to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103fef9cb206d5940bba7c6c6cda7354bbb 2023-03-14 14:54:32,691 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-14 14:54:32,704 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-14 14:54:32,704 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:39372, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-14 14:54:32,711 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-14 14:54:32,712 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:36466, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-14 14:54:32,721 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/8f9251a5be0445258b6abf72503015bd first=Optional[r3] last=Optional[r6] 2023-03-14 14:54:32,722 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a., hostname=jenkins-hbase20.apache.org,41317,1678805580877, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/8f9251a5be0445258b6abf72503015bd}] 2023-03-14 14:54:32,726 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/8f9251a5be0445258b6abf72503015bd for inclusion in 4e01724a8ecff4aa30dbfa9d68c1991a/family1 2023-03-14 14:54:32,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-03-14 14:54:32,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(777): Region bounds: first= last= 2023-03-14 14:54:32,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HRegion(2446): Flush status journal for 4e01724a8ecff4aa30dbfa9d68c1991a: 2023-03-14 14:54:32,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/8f9251a5be0445258b6abf72503015bd to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__jpchb1m5192i31b9f7a7bmcfu0e49tpginv2gr8tf8la8p37gdnahk71b2bb14l4/family1/8f9251a5be0445258b6abf72503015bd 2023-03-14 14:54:32,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__jpchb1m5192i31b9f7a7bmcfu0e49tpginv2gr8tf8la8p37gdnahk71b2bb14l4/family1/8f9251a5be0445258b6abf72503015bd as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/3221d5c45fca4bacb8d2098a837e152b_SeqId_44_ 2023-03-14 14:54:32,733 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__jpchb1m5192i31b9f7a7bmcfu0e49tpginv2gr8tf8la8p37gdnahk71b2bb14l4/family1/8f9251a5be0445258b6abf72503015bd into 4e01724a8ecff4aa30dbfa9d68c1991a/family1 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/3221d5c45fca4bacb8d2098a837e152b_SeqId_44_ - updating store file list. 2023-03-14 14:54:32,736 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/3221d5c45fca4bacb8d2098a837e152b_SeqId_44_ into 4e01724a8ecff4aa30dbfa9d68c1991a/family1 2023-03-14 14:54:32,736 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__jpchb1m5192i31b9f7a7bmcfu0e49tpginv2gr8tf8la8p37gdnahk71b2bb14l4/family1/8f9251a5be0445258b6abf72503015bd into 4e01724a8ecff4aa30dbfa9d68c1991a/family1 (new location: hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/3221d5c45fca4bacb8d2098a837e152b_SeqId_44_) 2023-03-14 14:54:32,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__jpchb1m5192i31b9f7a7bmcfu0e49tpginv2gr8tf8la8p37gdnahk71b2bb14l4/family1/8f9251a5be0445258b6abf72503015bd 2023-03-14 14:54:32,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-14 14:54:32,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51552 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-14 14:54:32,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(1912): 4e01724a8ecff4aa30dbfa9d68c1991a/family1 is initiating minor compaction 2023-03-14 14:54:32,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@7336748c; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-14 14:54:32,739 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 4e01724a8ecff4aa30dbfa9d68c1991a/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a. 2023-03-14 14:54:32,740 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/2fe14625c3d64eba92454aaf9f71a917, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/cd747496f7de4ee2b532ad6225968467, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/3808f41c705749218e36670707ac68b2, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/aee678a2fb494369b878eba81bbdf8f7, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/cea9a8b6b5ed45beafe2cb0a90a9b172, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/7f44fd62e3c14be1b0b56db1f0937cad, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/885e03faafba4fdb8ec1480bc3ae361f, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/d94da5f6f2204adbbf065c2512da63d4, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/32b66643cf28405eaf9e4a3f28f9a3e4, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/3221d5c45fca4bacb8d2098a837e152b_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/.tmp, totalSize=50.3 K 2023-03-14 14:54:32,740 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting 2fe14625c3d64eba92454aaf9f71a917, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-14 14:54:32,740 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting cd747496f7de4ee2b532ad6225968467, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-14 14:54:32,740 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting 3808f41c705749218e36670707ac68b2, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-14 14:54:32,740 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting aee678a2fb494369b878eba81bbdf8f7, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-14 14:54:32,740 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting cea9a8b6b5ed45beafe2cb0a90a9b172, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-14 14:54:32,740 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting 7f44fd62e3c14be1b0b56db1f0937cad, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-14 14:54:32,740 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting 885e03faafba4fdb8ec1480bc3ae361f, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-14 14:54:32,740 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting d94da5f6f2204adbbf065c2512da63d4, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-14 14:54:32,740 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting 32b66643cf28405eaf9e4a3f28f9a3e4, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-14 14:54:32,740 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting 3221d5c45fca4bacb8d2098a837e152b_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-14 14:54:32,741 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-14 14:54:32,742 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 14:54:32,743 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512285908b0e0d9eb40509d3f374b3ca77744 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512285908b0e0d9eb40509d3f374b3ca77744 2023-03-14 14:54:32,744 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512318e845a7898b34013b2675dab26c576b4 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512318e845a7898b34013b2675dab26c576b4 2023-03-14 14:54:32,745 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101033e725254de422586c674e06763712b to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101033e725254de422586c674e06763712b 2023-03-14 14:54:32,746 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103ba8e276db5c84d35b444de421573a934 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103ba8e276db5c84d35b444de421573a934 2023-03-14 14:54:32,746 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 4 expired mob files are deleted 2023-03-14 14:54:32,746 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-03-14 14:54:32,746 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-14 14:54:32,746 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-14 14:54:32,746 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-14 14:54:32,746 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-14 14:54:32,746 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-14 14:54:32,746 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-14 14:54:32,746 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-14 14:54:32,747 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-14 14:54:32,763 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] throttle.PressureAwareThroughputController(145): 4e01724a8ecff4aa30dbfa9d68c1991a#family1#compaction#73 average throughput is 0.79 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 80.77 MB/second 2023-03-14 14:54:33,588 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/.tmp/family1/56248c5682374795befa5efdaedc7456 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/56248c5682374795befa5efdaedc7456 2023-03-14 14:54:33,589 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512058945a8c37b5b40218256b0e03d8955b3 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512058945a8c37b5b40218256b0e03d8955b3 2023-03-14 14:54:33,590 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-14 14:54:33,595 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 4e01724a8ecff4aa30dbfa9d68c1991a/family1 of 4e01724a8ecff4aa30dbfa9d68c1991a into 56248c5682374795befa5efdaedc7456(size=6.8 K), total size for store is 197.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-14 14:54:33,595 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 4e01724a8ecff4aa30dbfa9d68c1991a: 2023-03-14 14:54:33,595 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a., storeName=family1, fileCount=10, fileSize=50.3 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1678805672739; duration=0sec 2023-03-14 14:54:33,595 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-14 14:54:33,625 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/2fe14625c3d64eba92454aaf9f71a917, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/cd747496f7de4ee2b532ad6225968467, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/3808f41c705749218e36670707ac68b2, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/aee678a2fb494369b878eba81bbdf8f7, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/cea9a8b6b5ed45beafe2cb0a90a9b172, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/7f44fd62e3c14be1b0b56db1f0937cad, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/885e03faafba4fdb8ec1480bc3ae361f, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/d94da5f6f2204adbbf065c2512da63d4, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/32b66643cf28405eaf9e4a3f28f9a3e4, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/3221d5c45fca4bacb8d2098a837e152b_SeqId_44_] to archive 2023-03-14 14:54:33,626 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/31e44cd2376f4e18bd2aa01be7afeae1 first=Optional[r00] last=Optional[r2] 2023-03-14 14:54:33,626 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 14:54:33,627 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a., hostname=jenkins-hbase20.apache.org,41317,1678805580877, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/31e44cd2376f4e18bd2aa01be7afeae1}] 2023-03-14 14:54:33,629 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/31e44cd2376f4e18bd2aa01be7afeae1 for inclusion in 4e01724a8ecff4aa30dbfa9d68c1991a/family1 2023-03-14 14:54:33,629 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/2fe14625c3d64eba92454aaf9f71a917 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/2fe14625c3d64eba92454aaf9f71a917 2023-03-14 14:54:33,631 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/cd747496f7de4ee2b532ad6225968467 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/cd747496f7de4ee2b532ad6225968467 2023-03-14 14:54:33,633 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/3808f41c705749218e36670707ac68b2 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/3808f41c705749218e36670707ac68b2 2023-03-14 14:54:33,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-03-14 14:54:33,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(777): Region bounds: first= last= 2023-03-14 14:54:33,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HRegion(2446): Flush status journal for 4e01724a8ecff4aa30dbfa9d68c1991a: 2023-03-14 14:54:33,634 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/aee678a2fb494369b878eba81bbdf8f7 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/aee678a2fb494369b878eba81bbdf8f7 2023-03-14 14:54:33,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/31e44cd2376f4e18bd2aa01be7afeae1 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__m1ulr24nle8r50jueicbmbb2qp6jm6mr36nctk3grvvjco2que5euepf06lciqvv/family1/31e44cd2376f4e18bd2aa01be7afeae1 2023-03-14 14:54:33,635 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/cea9a8b6b5ed45beafe2cb0a90a9b172 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/cea9a8b6b5ed45beafe2cb0a90a9b172 2023-03-14 14:54:33,636 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/7f44fd62e3c14be1b0b56db1f0937cad to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/7f44fd62e3c14be1b0b56db1f0937cad 2023-03-14 14:54:33,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__m1ulr24nle8r50jueicbmbb2qp6jm6mr36nctk3grvvjco2que5euepf06lciqvv/family1/31e44cd2376f4e18bd2aa01be7afeae1 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/a960a7ae3e5343d59907859507352010_SeqId_47_ 2023-03-14 14:54:33,637 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__m1ulr24nle8r50jueicbmbb2qp6jm6mr36nctk3grvvjco2que5euepf06lciqvv/family1/31e44cd2376f4e18bd2aa01be7afeae1 into 4e01724a8ecff4aa30dbfa9d68c1991a/family1 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/a960a7ae3e5343d59907859507352010_SeqId_47_ - updating store file list. 2023-03-14 14:54:33,637 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/885e03faafba4fdb8ec1480bc3ae361f to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/885e03faafba4fdb8ec1480bc3ae361f 2023-03-14 14:54:33,639 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/d94da5f6f2204adbbf065c2512da63d4 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/d94da5f6f2204adbbf065c2512da63d4 2023-03-14 14:54:33,640 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/32b66643cf28405eaf9e4a3f28f9a3e4 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/32b66643cf28405eaf9e4a3f28f9a3e4 2023-03-14 14:54:33,641 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/3221d5c45fca4bacb8d2098a837e152b_SeqId_44_ to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/3221d5c45fca4bacb8d2098a837e152b_SeqId_44_ 2023-03-14 14:54:33,641 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/a960a7ae3e5343d59907859507352010_SeqId_47_ into 4e01724a8ecff4aa30dbfa9d68c1991a/family1 2023-03-14 14:54:33,641 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__m1ulr24nle8r50jueicbmbb2qp6jm6mr36nctk3grvvjco2que5euepf06lciqvv/family1/31e44cd2376f4e18bd2aa01be7afeae1 into 4e01724a8ecff4aa30dbfa9d68c1991a/family1 (new location: hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/a960a7ae3e5343d59907859507352010_SeqId_47_) 2023-03-14 14:54:33,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__m1ulr24nle8r50jueicbmbb2qp6jm6mr36nctk3grvvjco2que5euepf06lciqvv/family1/31e44cd2376f4e18bd2aa01be7afeae1 2023-03-14 14:54:33,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-03-14 14:54:33,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 397422 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-03-14 14:54:33,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(1912): 4e01724a8ecff4aa30dbfa9d68c1991a/family1 is initiating minor compaction (all files) 2023-03-14 14:54:33,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@1608e2e7; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-14 14:54:33,642 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 4e01724a8ecff4aa30dbfa9d68c1991a/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a. 2023-03-14 14:54:33,643 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/cf2fd46ee0ab4278b3a596118e27b4a0, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/56248c5682374795befa5efdaedc7456, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/a960a7ae3e5343d59907859507352010_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/.tmp, totalSize=388.1 K 2023-03-14 14:54:33,643 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting cf2fd46ee0ab4278b3a596118e27b4a0, keycount=1000, bloomtype=ROW, size=190.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878806007 2023-03-14 14:54:33,643 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting 56248c5682374795befa5efdaedc7456, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621206007 2023-03-14 14:54:33,644 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting a960a7ae3e5343d59907859507352010_SeqId_47_, keycount=1002, bloomtype=ROW, size=190.9 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878806007 2023-03-14 14:54:33,644 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-14 14:54:33,645 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 14:54:33,646 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130eaa7c5cfba874b85a8c6f719c084ce2c to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130eaa7c5cfba874b85a8c6f719c084ce2c 2023-03-14 14:54:33,647 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512013199a4d5bede4fa9a96ddd261cf7995f to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512013199a4d5bede4fa9a96ddd261cf7995f 2023-03-14 14:54:33,648 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512058cb86bac054d4c8084770ffc2c53292f to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512058cb86bac054d4c8084770ffc2c53292f 2023-03-14 14:54:33,649 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 3 expired mob files are deleted 2023-03-14 14:54:33,649 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-03-14 14:54:33,649 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-14 14:54:33,649 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-14 14:54:33,649 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-14 14:54:33,651 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=58, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-14 14:54:33,652 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=58, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 1.8260 sec 2023-03-14 14:54:33,660 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] throttle.PressureAwareThroughputController(145): 4e01724a8ecff4aa30dbfa9d68c1991a#family1#compaction#74 average throughput is 22.45 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 80.77 MB/second 2023-03-14 14:54:33,710 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.HMaster$12(2454): Client=jenkins//148.251.75.209 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-03-14 14:54:33,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure2.ProcedureExecutor(1029): Stored pid=59, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:34,121 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-03-14 14:54:34,124 DEBUG [PEWorker-3] util.FSTableDescriptors(519): Deleted hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-03-14 14:54:34,124 INFO [PEWorker-3] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-03-14 14:54:34,129 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-03-14 14:54:34,133 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=4e01724a8ecff4aa30dbfa9d68c1991a, REOPEN/MOVE}] 2023-03-14 14:54:34,134 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=4e01724a8ecff4aa30dbfa9d68c1991a, REOPEN/MOVE 2023-03-14 14:54:34,134 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=4e01724a8ecff4aa30dbfa9d68c1991a, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:34,135 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1678805674134"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1678805674134"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678805674134"}]},"ts":"1678805674134"} 2023-03-14 14:54:34,136 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=62, ppid=61, state=RUNNABLE; CloseRegionProcedure 4e01724a8ecff4aa30dbfa9d68c1991a, server=jenkins-hbase20.apache.org,41317,1678805580877}] 2023-03-14 14:54:34,287 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 4e01724a8ecff4aa30dbfa9d68c1991a 2023-03-14 14:54:34,288 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 4e01724a8ecff4aa30dbfa9d68c1991a, disabling compactions & flushes 2023-03-14 14:54:34,288 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a. 2023-03-14 14:54:34,495 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/.tmp/family1/4bb0a4717a584ad3b1c3169d9436bf36 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/4bb0a4717a584ad3b1c3169d9436bf36 2023-03-14 14:54:34,501 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 4e01724a8ecff4aa30dbfa9d68c1991a/family1 of 4e01724a8ecff4aa30dbfa9d68c1991a into 4bb0a4717a584ad3b1c3169d9436bf36(size=192.0 K), total size for store is 192.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-14 14:54:34,501 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 4e01724a8ecff4aa30dbfa9d68c1991a: 2023-03-14 14:54:34,501 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a. 2023-03-14 14:54:34,502 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a. 2023-03-14 14:54:34,502 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a., storeName=family1, fileCount=3, fileSize=388.1 K (190.5 K, 6.8 K, 190.9 K), priority=2, time=1678805673642; duration=0sec 2023-03-14 14:54:34,502 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a. after waiting 0 ms 2023-03-14 14:54:34,502 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-14 14:54:34,502 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a. 2023-03-14 14:54:34,506 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/cf2fd46ee0ab4278b3a596118e27b4a0, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/56248c5682374795befa5efdaedc7456, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/a960a7ae3e5343d59907859507352010_SeqId_47_] to archive 2023-03-14 14:54:34,507 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 14:54:34,509 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/cf2fd46ee0ab4278b3a596118e27b4a0 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/cf2fd46ee0ab4278b3a596118e27b4a0 2023-03-14 14:54:34,511 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/56248c5682374795befa5efdaedc7456 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/56248c5682374795befa5efdaedc7456 2023-03-14 14:54:34,513 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/a960a7ae3e5343d59907859507352010_SeqId_47_ to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/a960a7ae3e5343d59907859507352010_SeqId_47_ 2023-03-14 14:54:34,520 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-03-14 14:54:34,521 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a. 2023-03-14 14:54:34,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 4e01724a8ecff4aa30dbfa9d68c1991a: 2023-03-14 14:54:34,521 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 4e01724a8ecff4aa30dbfa9d68c1991a to self. 2023-03-14 14:54:34,523 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 4e01724a8ecff4aa30dbfa9d68c1991a 2023-03-14 14:54:34,524 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=4e01724a8ecff4aa30dbfa9d68c1991a, regionState=CLOSED 2023-03-14 14:54:34,524 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1678805674524"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678805674524"}]},"ts":"1678805674524"} 2023-03-14 14:54:34,527 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=62, resume processing ppid=61 2023-03-14 14:54:34,528 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=62, ppid=61, state=SUCCESS; CloseRegionProcedure 4e01724a8ecff4aa30dbfa9d68c1991a, server=jenkins-hbase20.apache.org,41317,1678805580877 in 389 msec 2023-03-14 14:54:34,528 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=4e01724a8ecff4aa30dbfa9d68c1991a, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase20.apache.org,41317,1678805580877; forceNewPlan=false, retain=true 2023-03-14 14:54:34,679 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=4e01724a8ecff4aa30dbfa9d68c1991a, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:34,679 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1678805674679"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1678805674679"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678805674679"}]},"ts":"1678805674679"} 2023-03-14 14:54:34,682 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=63, ppid=61, state=RUNNABLE; OpenRegionProcedure 4e01724a8ecff4aa30dbfa9d68c1991a, server=jenkins-hbase20.apache.org,41317,1678805580877}] 2023-03-14 14:54:34,838 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a. 2023-03-14 14:54:34,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4e01724a8ecff4aa30dbfa9d68c1991a, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a.', STARTKEY => '', ENDKEY => ''} 2023-03-14 14:54:34,839 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 4e01724a8ecff4aa30dbfa9d68c1991a 2023-03-14 14:54:34,839 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 14:54:34,839 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 4e01724a8ecff4aa30dbfa9d68c1991a 2023-03-14 14:54:34,839 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 4e01724a8ecff4aa30dbfa9d68c1991a 2023-03-14 14:54:34,841 INFO [StoreOpener-4e01724a8ecff4aa30dbfa9d68c1991a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 4e01724a8ecff4aa30dbfa9d68c1991a 2023-03-14 14:54:34,843 DEBUG [StoreOpener-4e01724a8ecff4aa30dbfa9d68c1991a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1 2023-03-14 14:54:34,843 DEBUG [StoreOpener-4e01724a8ecff4aa30dbfa9d68c1991a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1 2023-03-14 14:54:34,843 INFO [StoreOpener-4e01724a8ecff4aa30dbfa9d68c1991a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4e01724a8ecff4aa30dbfa9d68c1991a columnFamilyName family1 2023-03-14 14:54:34,853 DEBUG [StoreOpener-4e01724a8ecff4aa30dbfa9d68c1991a-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/4bb0a4717a584ad3b1c3169d9436bf36 2023-03-14 14:54:34,853 INFO [StoreOpener-4e01724a8ecff4aa30dbfa9d68c1991a-1] regionserver.HStore(310): Store=4e01724a8ecff4aa30dbfa9d68c1991a/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 14:54:34,855 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a 2023-03-14 14:54:34,857 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a 2023-03-14 14:54:34,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 4e01724a8ecff4aa30dbfa9d68c1991a 2023-03-14 14:54:34,862 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 4e01724a8ecff4aa30dbfa9d68c1991a; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72790993, jitterRate=0.08467032015323639}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-14 14:54:34,862 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 4e01724a8ecff4aa30dbfa9d68c1991a: 2023-03-14 14:54:34,863 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a., pid=63, masterSystemTime=1678805674835 2023-03-14 14:54:34,864 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a. 2023-03-14 14:54:34,864 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a. 2023-03-14 14:54:34,864 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=4e01724a8ecff4aa30dbfa9d68c1991a, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:34,865 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1678805674864"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1678805674864"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678805674864"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678805674864"}]},"ts":"1678805674864"} 2023-03-14 14:54:34,867 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=63, resume processing ppid=61 2023-03-14 14:54:34,867 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=63, ppid=61, state=SUCCESS; OpenRegionProcedure 4e01724a8ecff4aa30dbfa9d68c1991a, server=jenkins-hbase20.apache.org,41317,1678805580877 in 184 msec 2023-03-14 14:54:34,868 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=60 2023-03-14 14:54:34,868 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=60, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=4e01724a8ecff4aa30dbfa9d68c1991a, REOPEN/MOVE in 734 msec 2023-03-14 14:54:34,870 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-03-14 14:54:34,870 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 740 msec 2023-03-14 14:54:34,871 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=59, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.1590 sec 2023-03-14 14:54:34,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=59 2023-03-14 14:54:34,873 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(278): alter status finished 2023-03-14 14:54:34,874 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=38031] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:34,875 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-14 14:54:34,875 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-14 14:54:34,876 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-14 14:54:34,876 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678806274876 2023-03-14 14:54:34,877 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-14 14:54:34,877 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-03-14 14:54:34,877 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-14 14:54:34,878 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] zookeeper.ReadOnlyZKClient(139): Connect 0x47325cc4 to 127.0.0.1:50211 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-14 14:54:34,881 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3789756f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-14 14:54:34,882 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-14 14:54:34,882 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-14 14:54:34,882 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-14 14:54:34,882 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-14 14:54:34,882 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-14 14:54:35,705 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511282ca7a7b16be84bfc877ab817abf3d11c to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511282ca7a7b16be84bfc877ab817abf3d11c 2023-03-14 14:54:35,706 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-14 14:54:35,720 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-14 14:54:35,721 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:39388, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-14 14:54:35,727 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-14 14:54:35,729 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:36476, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-14 14:54:35,740 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/ec86aa9ea4bd4e1fbed10a60c56cc8dc first=Optional[r05] last=Optional[r8] 2023-03-14 14:54:35,740 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a., hostname=jenkins-hbase20.apache.org,41317,1678805580877, seqNum=51 for row with hfile group [{family1,hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/ec86aa9ea4bd4e1fbed10a60c56cc8dc}] 2023-03-14 14:54:35,745 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/ec86aa9ea4bd4e1fbed10a60c56cc8dc for inclusion in 4e01724a8ecff4aa30dbfa9d68c1991a/family1 2023-03-14 14:54:35,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-03-14 14:54:35,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(777): Region bounds: first= last= 2023-03-14 14:54:35,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HRegion(2446): Flush status journal for 4e01724a8ecff4aa30dbfa9d68c1991a: 2023-03-14 14:54:35,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/ec86aa9ea4bd4e1fbed10a60c56cc8dc to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__l9ihdh0e2qqsfd7ndlfl1n9uianog35v3vibvptettf3i213mt78ue64di5lg0kl/family1/ec86aa9ea4bd4e1fbed10a60c56cc8dc 2023-03-14 14:54:35,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__l9ihdh0e2qqsfd7ndlfl1n9uianog35v3vibvptettf3i213mt78ue64di5lg0kl/family1/ec86aa9ea4bd4e1fbed10a60c56cc8dc as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/e27c827f2dfe46d2b69fb45e55cfbdaa_SeqId_53_ 2023-03-14 14:54:35,751 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__l9ihdh0e2qqsfd7ndlfl1n9uianog35v3vibvptettf3i213mt78ue64di5lg0kl/family1/ec86aa9ea4bd4e1fbed10a60c56cc8dc into 4e01724a8ecff4aa30dbfa9d68c1991a/family1 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/e27c827f2dfe46d2b69fb45e55cfbdaa_SeqId_53_ - updating store file list. 2023-03-14 14:54:35,754 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/e27c827f2dfe46d2b69fb45e55cfbdaa_SeqId_53_ into 4e01724a8ecff4aa30dbfa9d68c1991a/family1 2023-03-14 14:54:35,754 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__l9ihdh0e2qqsfd7ndlfl1n9uianog35v3vibvptettf3i213mt78ue64di5lg0kl/family1/ec86aa9ea4bd4e1fbed10a60c56cc8dc into 4e01724a8ecff4aa30dbfa9d68c1991a/family1 (new location: hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/e27c827f2dfe46d2b69fb45e55cfbdaa_SeqId_53_) 2023-03-14 14:54:35,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__l9ihdh0e2qqsfd7ndlfl1n9uianog35v3vibvptettf3i213mt78ue64di5lg0kl/family1/ec86aa9ea4bd4e1fbed10a60c56cc8dc 2023-03-14 14:54:35,756 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-14 14:54:35,757 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 14:54:35,758 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511200354d6bd62614b97a4e8cfffd6785cf7 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511200354d6bd62614b97a4e8cfffd6785cf7 2023-03-14 14:54:35,759 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128da686e5ae99e41d6addcba09bea21e69 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128da686e5ae99e41d6addcba09bea21e69 2023-03-14 14:54:35,759 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2 expired mob files are deleted 2023-03-14 14:54:35,759 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-03-14 14:54:35,760 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-14 14:54:35,760 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-14 14:54:35,760 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-14 14:54:35,760 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-14 14:54:35,760 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-14 14:54:35,761 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-14 14:54:35,762 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 887 msec 2023-03-14 14:54:35,818 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.HMaster$12(2454): Client=jenkins//148.251.75.209 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'} 2023-03-14 14:54:35,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:36,230 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-03-14 14:54:36,233 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-03-14 14:54:36,233 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-03-14 14:54:36,239 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=66, ppid=65, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-03-14 14:54:36,243 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=4e01724a8ecff4aa30dbfa9d68c1991a, REOPEN/MOVE}] 2023-03-14 14:54:36,244 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=4e01724a8ecff4aa30dbfa9d68c1991a, REOPEN/MOVE 2023-03-14 14:54:36,245 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=4e01724a8ecff4aa30dbfa9d68c1991a, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:36,245 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1678805676245"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1678805676245"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678805676245"}]},"ts":"1678805676245"} 2023-03-14 14:54:36,247 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=68, ppid=67, state=RUNNABLE; CloseRegionProcedure 4e01724a8ecff4aa30dbfa9d68c1991a, server=jenkins-hbase20.apache.org,41317,1678805580877}] 2023-03-14 14:54:36,400 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 4e01724a8ecff4aa30dbfa9d68c1991a 2023-03-14 14:54:36,400 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 4e01724a8ecff4aa30dbfa9d68c1991a, disabling compactions & flushes 2023-03-14 14:54:36,400 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a. 2023-03-14 14:54:36,401 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a. 2023-03-14 14:54:36,401 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a. after waiting 0 ms 2023-03-14 14:54:36,401 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a. 2023-03-14 14:54:36,411 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-03-14 14:54:36,413 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a. 2023-03-14 14:54:36,413 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 4e01724a8ecff4aa30dbfa9d68c1991a: 2023-03-14 14:54:36,413 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 4e01724a8ecff4aa30dbfa9d68c1991a to self. 2023-03-14 14:54:36,415 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 4e01724a8ecff4aa30dbfa9d68c1991a 2023-03-14 14:54:36,416 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=4e01724a8ecff4aa30dbfa9d68c1991a, regionState=CLOSED 2023-03-14 14:54:36,416 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1678805676416"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678805676416"}]},"ts":"1678805676416"} 2023-03-14 14:54:36,420 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=67 2023-03-14 14:54:36,420 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=67, state=SUCCESS; CloseRegionProcedure 4e01724a8ecff4aa30dbfa9d68c1991a, server=jenkins-hbase20.apache.org,41317,1678805580877 in 171 msec 2023-03-14 14:54:36,421 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=4e01724a8ecff4aa30dbfa9d68c1991a, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase20.apache.org,41317,1678805580877; forceNewPlan=false, retain=true 2023-03-14 14:54:36,572 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=4e01724a8ecff4aa30dbfa9d68c1991a, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:36,572 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1678805676572"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1678805676572"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678805676572"}]},"ts":"1678805676572"} 2023-03-14 14:54:36,576 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 4e01724a8ecff4aa30dbfa9d68c1991a, server=jenkins-hbase20.apache.org,41317,1678805580877}] 2023-03-14 14:54:36,737 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a. 2023-03-14 14:54:36,737 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4e01724a8ecff4aa30dbfa9d68c1991a, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a.', STARTKEY => '', ENDKEY => ''} 2023-03-14 14:54:36,737 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 4e01724a8ecff4aa30dbfa9d68c1991a 2023-03-14 14:54:36,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 14:54:36,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 4e01724a8ecff4aa30dbfa9d68c1991a 2023-03-14 14:54:36,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 4e01724a8ecff4aa30dbfa9d68c1991a 2023-03-14 14:54:36,741 INFO [StoreOpener-4e01724a8ecff4aa30dbfa9d68c1991a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 4e01724a8ecff4aa30dbfa9d68c1991a 2023-03-14 14:54:36,743 DEBUG [StoreOpener-4e01724a8ecff4aa30dbfa9d68c1991a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1 2023-03-14 14:54:36,743 DEBUG [StoreOpener-4e01724a8ecff4aa30dbfa9d68c1991a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1 2023-03-14 14:54:36,744 INFO [StoreOpener-4e01724a8ecff4aa30dbfa9d68c1991a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4e01724a8ecff4aa30dbfa9d68c1991a columnFamilyName family1 2023-03-14 14:54:36,755 DEBUG [StoreOpener-4e01724a8ecff4aa30dbfa9d68c1991a-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/4bb0a4717a584ad3b1c3169d9436bf36 2023-03-14 14:54:36,761 DEBUG [StoreOpener-4e01724a8ecff4aa30dbfa9d68c1991a-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/family1/e27c827f2dfe46d2b69fb45e55cfbdaa_SeqId_53_ 2023-03-14 14:54:36,762 INFO [StoreOpener-4e01724a8ecff4aa30dbfa9d68c1991a-1] regionserver.HStore(310): Store=4e01724a8ecff4aa30dbfa9d68c1991a/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 14:54:36,763 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a 2023-03-14 14:54:36,764 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a 2023-03-14 14:54:36,767 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 4e01724a8ecff4aa30dbfa9d68c1991a 2023-03-14 14:54:36,768 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 4e01724a8ecff4aa30dbfa9d68c1991a; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60788957, jitterRate=-0.09417395293712616}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-14 14:54:36,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 4e01724a8ecff4aa30dbfa9d68c1991a: 2023-03-14 14:54:36,769 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a., pid=69, masterSystemTime=1678805676730 2023-03-14 14:54:36,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a. 2023-03-14 14:54:36,770 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a. 2023-03-14 14:54:36,770 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=4e01724a8ecff4aa30dbfa9d68c1991a, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:36,770 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1678805676770"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1678805676770"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678805676770"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678805676770"}]},"ts":"1678805676770"} 2023-03-14 14:54:36,773 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-03-14 14:54:36,773 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 4e01724a8ecff4aa30dbfa9d68c1991a, server=jenkins-hbase20.apache.org,41317,1678805580877 in 196 msec 2023-03-14 14:54:36,774 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-03-14 14:54:36,775 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=4e01724a8ecff4aa30dbfa9d68c1991a, REOPEN/MOVE in 530 msec 2023-03-14 14:54:36,777 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=66, resume processing ppid=65 2023-03-14 14:54:36,777 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=66, ppid=65, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 536 msec 2023-03-14 14:54:36,779 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 960 msec 2023-03-14 14:54:36,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=65 2023-03-14 14:54:36,782 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(278): alter status finished 2023-03-14 14:54:36,783 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=38031] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-03-14 14:54:36,784 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] procedure2.ProcedureExecutor(1029): Stored pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-14 14:54:36,785 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-14 14:54:36,785 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-14 14:54:36,785 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=70, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678806276785 2023-03-14 14:54:36,786 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-14 14:54:36,787 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-03-14 14:54:36,787 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-14 14:54:36,788 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] zookeeper.ReadOnlyZKClient(139): Connect 0x07e7f390 to 127.0.0.1:50211 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-14 14:54:36,792 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@51722ac7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-14 14:54:36,792 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-14 14:54:36,793 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-14 14:54:36,793 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-14 14:54:36,793 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-14 14:54:36,793 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-14 14:54:36,793 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-14 14:54:36,793 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-14 14:54:36,793 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-03-14 14:54:36,793 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-03-14 14:54:36,793 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-14 14:54:36,794 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=70, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-03-14 14:54:36,796 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=70, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 11 msec 2023-03-14 14:54:36,837 INFO [Listener at localhost.localdomain/44261] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=249 (was 244) - Thread LEAK? -, OpenFileDescriptor=636 (was 612) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=175 (was 225), ProcessCount=170 (was 170), AvailableMemoryMB=12384 (was 12366) - AvailableMemoryMB LEAK? - 2023-03-14 14:54:36,846 INFO [Listener at localhost.localdomain/44261] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=249, OpenFileDescriptor=636, MaxFileDescriptor=60000, SystemLoadAverage=175, ProcessCount=170, AvailableMemoryMB=12384 2023-03-14 14:54:36,850 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-03-14 14:54:36,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testGetAfterCompaction 2023-03-14 14:54:36,852 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-03-14 14:54:36,852 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testGetAfterCompaction" procId is: 71 2023-03-14 14:54:36,852 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-14 14:54:36,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-03-14 14:54:36,854 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555 2023-03-14 14:54:36,854 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555 empty. 2023-03-14 14:54:36,854 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555 2023-03-14 14:54:36,854 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-03-14 14:54:36,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-03-14 14:54:37,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-03-14 14:54:37,264 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/default/testGetAfterCompaction/.tabledesc/.tableinfo.0000000001 2023-03-14 14:54:37,267 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0bcef87a6b6438389196033f1bfd1555, NAME => 'testGetAfterCompaction,,1678805676849.0bcef87a6b6438389196033f1bfd1555.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp 2023-03-14 14:54:37,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-03-14 14:54:37,678 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1678805676849.0bcef87a6b6438389196033f1bfd1555.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 14:54:37,678 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1604): Closing 0bcef87a6b6438389196033f1bfd1555, disabling compactions & flushes 2023-03-14 14:54:37,678 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1678805676849.0bcef87a6b6438389196033f1bfd1555. 2023-03-14 14:54:37,678 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1678805676849.0bcef87a6b6438389196033f1bfd1555. 2023-03-14 14:54:37,678 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1678805676849.0bcef87a6b6438389196033f1bfd1555. after waiting 0 ms 2023-03-14 14:54:37,678 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1678805676849.0bcef87a6b6438389196033f1bfd1555. 2023-03-14 14:54:37,678 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1678805676849.0bcef87a6b6438389196033f1bfd1555. 2023-03-14 14:54:37,678 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1558): Region close journal for 0bcef87a6b6438389196033f1bfd1555: 2023-03-14 14:54:37,682 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-03-14 14:54:37,685 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1678805676849.0bcef87a6b6438389196033f1bfd1555.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1678805677684"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678805677684"}]},"ts":"1678805677684"} 2023-03-14 14:54:37,687 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-14 14:54:37,689 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-14 14:54:37,689 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678805677689"}]},"ts":"1678805677689"} 2023-03-14 14:54:37,691 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLING in hbase:meta 2023-03-14 14:54:37,694 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=0bcef87a6b6438389196033f1bfd1555, ASSIGN}] 2023-03-14 14:54:37,696 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=0bcef87a6b6438389196033f1bfd1555, ASSIGN 2023-03-14 14:54:37,697 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testGetAfterCompaction, region=0bcef87a6b6438389196033f1bfd1555, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,41317,1678805580877; forceNewPlan=false, retain=false 2023-03-14 14:54:37,848 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=0bcef87a6b6438389196033f1bfd1555, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:37,849 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1678805676849.0bcef87a6b6438389196033f1bfd1555.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1678805677848"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1678805677848"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678805677848"}]},"ts":"1678805677848"} 2023-03-14 14:54:37,852 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=73, ppid=72, state=RUNNABLE; OpenRegionProcedure 0bcef87a6b6438389196033f1bfd1555, server=jenkins-hbase20.apache.org,41317,1678805580877}] 2023-03-14 14:54:37,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-03-14 14:54:38,010 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testGetAfterCompaction,,1678805676849.0bcef87a6b6438389196033f1bfd1555. 2023-03-14 14:54:38,010 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0bcef87a6b6438389196033f1bfd1555, NAME => 'testGetAfterCompaction,,1678805676849.0bcef87a6b6438389196033f1bfd1555.', STARTKEY => '', ENDKEY => ''} 2023-03-14 14:54:38,011 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro with path null and priority 1073741823 2023-03-14 14:54:38,014 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro from HTD of testGetAfterCompaction successfully. 2023-03-14 14:54:38,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testGetAfterCompaction 0bcef87a6b6438389196033f1bfd1555 2023-03-14 14:54:38,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1678805676849.0bcef87a6b6438389196033f1bfd1555.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 14:54:38,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 0bcef87a6b6438389196033f1bfd1555 2023-03-14 14:54:38,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 0bcef87a6b6438389196033f1bfd1555 2023-03-14 14:54:38,016 INFO [StoreOpener-0bcef87a6b6438389196033f1bfd1555-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0bcef87a6b6438389196033f1bfd1555 2023-03-14 14:54:38,017 DEBUG [StoreOpener-0bcef87a6b6438389196033f1bfd1555-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1 2023-03-14 14:54:38,017 DEBUG [StoreOpener-0bcef87a6b6438389196033f1bfd1555-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1 2023-03-14 14:54:38,017 INFO [StoreOpener-0bcef87a6b6438389196033f1bfd1555-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0bcef87a6b6438389196033f1bfd1555 columnFamilyName f1 2023-03-14 14:54:38,018 INFO [StoreOpener-0bcef87a6b6438389196033f1bfd1555-1] regionserver.HStore(310): Store=0bcef87a6b6438389196033f1bfd1555/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 14:54:38,019 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555 2023-03-14 14:54:38,020 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555 2023-03-14 14:54:38,022 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 0bcef87a6b6438389196033f1bfd1555 2023-03-14 14:54:38,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-14 14:54:38,024 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 0bcef87a6b6438389196033f1bfd1555; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68986297, jitterRate=0.027975931763648987}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-14 14:54:38,024 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 0bcef87a6b6438389196033f1bfd1555: 2023-03-14 14:54:38,024 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testGetAfterCompaction,,1678805676849.0bcef87a6b6438389196033f1bfd1555., pid=73, masterSystemTime=1678805678005 2023-03-14 14:54:38,025 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testGetAfterCompaction,,1678805676849.0bcef87a6b6438389196033f1bfd1555. 2023-03-14 14:54:38,025 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testGetAfterCompaction,,1678805676849.0bcef87a6b6438389196033f1bfd1555. 2023-03-14 14:54:38,026 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=0bcef87a6b6438389196033f1bfd1555, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:38,026 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testGetAfterCompaction,,1678805676849.0bcef87a6b6438389196033f1bfd1555.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1678805678026"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1678805678026"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678805678026"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678805678026"}]},"ts":"1678805678026"} 2023-03-14 14:54:38,028 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=72 2023-03-14 14:54:38,028 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=72, state=SUCCESS; OpenRegionProcedure 0bcef87a6b6438389196033f1bfd1555, server=jenkins-hbase20.apache.org,41317,1678805580877 in 175 msec 2023-03-14 14:54:38,029 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-03-14 14:54:38,029 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=0bcef87a6b6438389196033f1bfd1555, ASSIGN in 334 msec 2023-03-14 14:54:38,029 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-14 14:54:38,029 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678805678029"}]},"ts":"1678805678029"} 2023-03-14 14:54:38,030 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLED in hbase:meta 2023-03-14 14:54:38,031 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-03-14 14:54:38,032 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; CreateTableProcedure table=testGetAfterCompaction in 1.1810 sec 2023-03-14 14:54:38,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-03-14 14:54:38,960 INFO [Listener at localhost.localdomain/44261] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testGetAfterCompaction, procId: 71 completed 2023-03-14 14:54:38,961 DEBUG [Listener at localhost.localdomain/44261] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testGetAfterCompaction get assigned. Timeout = 60000ms 2023-03-14 14:54:38,966 INFO [Listener at localhost.localdomain/44261] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-03-14 14:54:38,972 INFO [Listener at localhost.localdomain/44261] hbase.HBaseTestingUtility(3484): All regions for table testGetAfterCompaction assigned to meta. Checking AM states. 2023-03-14 14:54:38,972 INFO [Listener at localhost.localdomain/44261] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-03-14 14:54:38,973 INFO [Listener at localhost.localdomain/44261] hbase.HBaseTestingUtility(3504): All regions for table testGetAfterCompaction assigned. 2023-03-14 14:54:38,977 INFO [Listener at localhost.localdomain/44261] regionserver.HRegion(2745): Flushing 0bcef87a6b6438389196033f1bfd1555 1/1 column families, dataSize=37 B heapSize=368 B 2023-03-14 14:54:39,391 INFO [Listener at localhost.localdomain/44261] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230314c9cb3e67c0744cd188ae6aa4c2d03e4d to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230314c9cb3e67c0744cd188ae6aa4c2d03e4d 2023-03-14 14:54:39,800 INFO [Listener at localhost.localdomain/44261] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/.tmp/f1/ea92b06781dc4c22a070f396fb2bb346 2023-03-14 14:54:39,813 DEBUG [Listener at localhost.localdomain/44261] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/.tmp/f1/ea92b06781dc4c22a070f396fb2bb346 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/ea92b06781dc4c22a070f396fb2bb346 2023-03-14 14:54:39,818 INFO [Listener at localhost.localdomain/44261] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/ea92b06781dc4c22a070f396fb2bb346, entries=1, sequenceid=5, filesize=4.9 K 2023-03-14 14:54:39,819 INFO [Listener at localhost.localdomain/44261] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 0bcef87a6b6438389196033f1bfd1555 in 842ms, sequenceid=5, compaction requested=false 2023-03-14 14:54:39,819 DEBUG [Listener at localhost.localdomain/44261] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testGetAfterCompaction' 2023-03-14 14:54:39,820 DEBUG [Listener at localhost.localdomain/44261] regionserver.HRegion(2446): Flush status journal for 0bcef87a6b6438389196033f1bfd1555: 2023-03-14 14:54:39,822 INFO [Listener at localhost.localdomain/44261] regionserver.HRegion(2745): Flushing 0bcef87a6b6438389196033f1bfd1555 1/1 column families, dataSize=37 B heapSize=368 B 2023-03-14 14:54:40,061 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-14 14:54:40,097 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-03-14 14:54:40,097 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro Metrics about HBase RegionObservers 2023-03-14 14:54:40,237 INFO [Listener at localhost.localdomain/44261] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230314da8682c896644103a88b99e019d84e98 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230314da8682c896644103a88b99e019d84e98 2023-03-14 14:54:40,646 INFO [Listener at localhost.localdomain/44261] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/.tmp/f1/4a06c7a70f7a41cb91b3d3034f576d91 2023-03-14 14:54:40,656 DEBUG [Listener at localhost.localdomain/44261] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/.tmp/f1/4a06c7a70f7a41cb91b3d3034f576d91 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/4a06c7a70f7a41cb91b3d3034f576d91 2023-03-14 14:54:40,661 INFO [Listener at localhost.localdomain/44261] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/4a06c7a70f7a41cb91b3d3034f576d91, entries=1, sequenceid=9, filesize=4.9 K 2023-03-14 14:54:40,663 INFO [Listener at localhost.localdomain/44261] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 0bcef87a6b6438389196033f1bfd1555 in 841ms, sequenceid=9, compaction requested=false 2023-03-14 14:54:40,663 DEBUG [Listener at localhost.localdomain/44261] regionserver.HRegion(2446): Flush status journal for 0bcef87a6b6438389196033f1bfd1555: 2023-03-14 14:54:40,665 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=38031] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testGetAfterCompaction 2023-03-14 14:54:40,666 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] procedure2.ProcedureExecutor(1029): Stored pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-03-14 14:54:40,666 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-03-14 14:54:40,667 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] mob.MobUtils(833): start MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-14 14:54:40,667 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=74, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678806280667 2023-03-14 14:54:40,667 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-03-14 14:54:40,668 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testGetAfterCompaction' and column 'f1' 2023-03-14 14:54:40,668 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testGetAfterCompaction' column='f1' 2023-03-14 14:54:40,668 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] zookeeper.ReadOnlyZKClient(139): Connect 0x64ecc1bc to 127.0.0.1:50211 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-14 14:54:40,671 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2408fbf4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-14 14:54:40,672 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230314 for table='testGetAfterCompaction' and column='f1' 2023-03-14 14:54:40,716 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/4a06c7a70f7a41cb91b3d3034f576d91; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678805680646; access_time=1678805679824; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 14:54:40,717 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/ea92b06781dc4c22a070f396fb2bb346; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678805679799; access_time=1678805678980; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 14:54:40,768 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/4a06c7a70f7a41cb91b3d3034f576d91; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678805680646; access_time=1678805679824; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 14:54:40,768 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/ea92b06781dc4c22a070f396fb2bb346; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678805679799; access_time=1678805678980; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 14:54:40,819 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/4a06c7a70f7a41cb91b3d3034f576d91; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678805680646; access_time=1678805679824; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 14:54:40,820 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/ea92b06781dc4c22a070f396fb2bb346; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678805679799; access_time=1678805678980; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 14:54:40,871 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/4a06c7a70f7a41cb91b3d3034f576d91; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678805680646; access_time=1678805679824; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 14:54:40,871 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/ea92b06781dc4c22a070f396fb2bb346; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678805679799; access_time=1678805678980; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 14:54:40,923 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/4a06c7a70f7a41cb91b3d3034f576d91; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678805680646; access_time=1678805679824; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 14:54:40,923 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/ea92b06781dc4c22a070f396fb2bb346; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678805679799; access_time=1678805678980; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 14:54:40,975 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/4a06c7a70f7a41cb91b3d3034f576d91; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678805680646; access_time=1678805679824; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 14:54:40,975 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/ea92b06781dc4c22a070f396fb2bb346; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678805679799; access_time=1678805678980; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 14:54:41,027 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/4a06c7a70f7a41cb91b3d3034f576d91; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678805680646; access_time=1678805679824; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 14:54:41,027 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/ea92b06781dc4c22a070f396fb2bb346; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678805679799; access_time=1678805678980; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 14:54:41,079 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/4a06c7a70f7a41cb91b3d3034f576d91; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678805680646; access_time=1678805679824; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 14:54:41,079 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/ea92b06781dc4c22a070f396fb2bb346; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678805679799; access_time=1678805678980; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 14:54:41,130 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/4a06c7a70f7a41cb91b3d3034f576d91; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678805680646; access_time=1678805679824; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 14:54:41,130 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/ea92b06781dc4c22a070f396fb2bb346; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678805679799; access_time=1678805678980; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 14:54:41,182 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/4a06c7a70f7a41cb91b3d3034f576d91; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678805680646; access_time=1678805679824; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 14:54:41,182 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/ea92b06781dc4c22a070f396fb2bb346; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678805679799; access_time=1678805678980; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 14:54:41,234 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/4a06c7a70f7a41cb91b3d3034f576d91; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678805680646; access_time=1678805679824; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 14:54:41,234 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/ea92b06781dc4c22a070f396fb2bb346; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678805679799; access_time=1678805678980; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 14:54:41,286 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/4a06c7a70f7a41cb91b3d3034f576d91; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678805680646; access_time=1678805679824; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 14:54:41,286 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/ea92b06781dc4c22a070f396fb2bb346; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678805679799; access_time=1678805678980; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 14:54:41,338 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/4a06c7a70f7a41cb91b3d3034f576d91; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678805680646; access_time=1678805679824; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 14:54:41,338 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/ea92b06781dc4c22a070f396fb2bb346; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678805679799; access_time=1678805678980; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 14:54:41,388 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-14 14:54:41,388 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5d5d87af to 127.0.0.1:50211 2023-03-14 14:54:41,388 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-14 14:54:41,388 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x39529775 to 127.0.0.1:50211 2023-03-14 14:54:41,388 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-14 14:54:41,388 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-14 14:54:41,388 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7e675d83 to 127.0.0.1:50211 2023-03-14 14:54:41,389 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-14 14:54:41,389 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x07e7f390 to 127.0.0.1:50211 2023-03-14 14:54:41,389 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-14 14:54:41,389 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-14 14:54:41,389 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/4a06c7a70f7a41cb91b3d3034f576d91; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678805680646; access_time=1678805679824; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 14:54:41,389 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6cf09fe5 to 127.0.0.1:50211 2023-03-14 14:54:41,389 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/ea92b06781dc4c22a070f396fb2bb346; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678805679799; access_time=1678805678980; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 14:54:41,389 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-14 14:54:41,389 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-14 14:54:41,389 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x47325cc4 to 127.0.0.1:50211 2023-03-14 14:54:41,389 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-14 14:54:41,440 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/4a06c7a70f7a41cb91b3d3034f576d91; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678805680646; access_time=1678805679824; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 14:54:41,440 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/ea92b06781dc4c22a070f396fb2bb346; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678805679799; access_time=1678805678980; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 14:54:41,491 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/4a06c7a70f7a41cb91b3d3034f576d91; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678805680646; access_time=1678805679824; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 14:54:41,492 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/ea92b06781dc4c22a070f396fb2bb346; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678805679799; access_time=1678805678980; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 14:54:41,505 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230314eabab151381d4344b7d83ff27dbba497 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230314eabab151381d4344b7d83ff27dbba497 2023-03-14 14:54:41,507 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230314 table='testGetAfterCompaction' column='f1' 2023-03-14 14:54:41,523 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-14 14:54:41,524 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:57954, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-14 14:54:41,529 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-14 14:54:41,531 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:46742, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-14 14:54:41,542 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230314/f1/0030e21109dd4321a16d43d6de091fdc first=Optional[r1] last=Optional[r2] 2023-03-14 14:54:41,542 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/4a06c7a70f7a41cb91b3d3034f576d91; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678805680646; access_time=1678805679824; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 14:54:41,543 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/ea92b06781dc4c22a070f396fb2bb346; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678805679799; access_time=1678805678980; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 14:54:41,543 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testGetAfterCompaction,,1678805676849.0bcef87a6b6438389196033f1bfd1555., hostname=jenkins-hbase20.apache.org,41317,1678805580877, seqNum=2 for row with hfile group [{f1,hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230314/f1/0030e21109dd4321a16d43d6de091fdc}] 2023-03-14 14:54:41,549 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230314/f1/0030e21109dd4321a16d43d6de091fdc for inclusion in 0bcef87a6b6438389196033f1bfd1555/f1 2023-03-14 14:54:41,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-03-14 14:54:41,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(777): Region bounds: first= last= 2023-03-14 14:54:41,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HRegion(2446): Flush status journal for 0bcef87a6b6438389196033f1bfd1555: 2023-03-14 14:54:41,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230314/f1/0030e21109dd4321a16d43d6de091fdc to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testGetAfterCompaction__islrqiat0cjg1vlvoshh6etlg72eotqqbpm9adtuqs8j8a1qtl30rglhkktikhjf/f1/0030e21109dd4321a16d43d6de091fdc 2023-03-14 14:54:41,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testGetAfterCompaction__islrqiat0cjg1vlvoshh6etlg72eotqqbpm9adtuqs8j8a1qtl30rglhkktikhjf/f1/0030e21109dd4321a16d43d6de091fdc as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/c51a32c3cf3e4f978bd61249edf7b8e2_SeqId_12_ 2023-03-14 14:54:41,554 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testGetAfterCompaction__islrqiat0cjg1vlvoshh6etlg72eotqqbpm9adtuqs8j8a1qtl30rglhkktikhjf/f1/0030e21109dd4321a16d43d6de091fdc into 0bcef87a6b6438389196033f1bfd1555/f1 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/c51a32c3cf3e4f978bd61249edf7b8e2_SeqId_12_ - updating store file list. 2023-03-14 14:54:41,557 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/c51a32c3cf3e4f978bd61249edf7b8e2_SeqId_12_ into 0bcef87a6b6438389196033f1bfd1555/f1 2023-03-14 14:54:41,557 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testGetAfterCompaction__islrqiat0cjg1vlvoshh6etlg72eotqqbpm9adtuqs8j8a1qtl30rglhkktikhjf/f1/0030e21109dd4321a16d43d6de091fdc into 0bcef87a6b6438389196033f1bfd1555/f1 (new location: hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/c51a32c3cf3e4f978bd61249edf7b8e2_SeqId_12_) 2023-03-14 14:54:41,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testGetAfterCompaction__islrqiat0cjg1vlvoshh6etlg72eotqqbpm9adtuqs8j8a1qtl30rglhkktikhjf/f1/0030e21109dd4321a16d43d6de091fdc 2023-03-14 14:54:41,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(1912): 0bcef87a6b6438389196033f1bfd1555/f1 is initiating minor compaction 2023-03-14 14:54:41,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@50c497d0; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-14 14:54:41,557 INFO [RS:0;jenkins-hbase20:41317-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 0bcef87a6b6438389196033f1bfd1555/f1 in testGetAfterCompaction,,1678805676849.0bcef87a6b6438389196033f1bfd1555. 2023-03-14 14:54:41,558 INFO [RS:0;jenkins-hbase20:41317-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/4a06c7a70f7a41cb91b3d3034f576d91, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/c51a32c3cf3e4f978bd61249edf7b8e2_SeqId_12_] into tmpdir=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/.tmp, totalSize=10.0 K 2023-03-14 14:54:41,558 DEBUG [RS:0;jenkins-hbase20:41317-longCompactions-0] compactions.Compactor(207): Compacting 4a06c7a70f7a41cb91b3d3034f576d91, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-14 14:54:41,558 DEBUG [RS:0;jenkins-hbase20:41317-longCompactions-0] compactions.Compactor(207): Compacting c51a32c3cf3e4f978bd61249edf7b8e2_SeqId_12_, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-14 14:54:41,559 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230314 table='testGetAfterCompaction' column='f1' 2023-03-14 14:54:41,560 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 14:54:41,562 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230314c9cb3e67c0744cd188ae6aa4c2d03e4d to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230314c9cb3e67c0744cd188ae6aa4c2d03e4d 2023-03-14 14:54:41,563 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230314da8682c896644103a88b99e019d84e98 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230314da8682c896644103a88b99e019d84e98 2023-03-14 14:54:41,563 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testGetAfterCompaction 2 expired mob files are deleted 2023-03-14 14:54:41,563 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230314' 2023-03-14 14:54:41,564 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230314 for table='testGetAfterCompaction' and column='f1' 2023-03-14 14:54:41,564 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testGetAfterCompaction' column='f1' 2023-03-14 14:54:41,564 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] mob.MobUtils(840): end MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-14 14:54:41,565 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=74, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-03-14 14:54:41,565 INFO [RS:0;jenkins-hbase20:41317-longCompactions-0] throttle.PressureAwareThroughputController(145): 0bcef87a6b6438389196033f1bfd1555#f1#compaction#77 average throughput is 0.13 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 80.77 MB/second 2023-03-14 14:54:41,566 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=74, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE in 900 msec 2023-03-14 14:54:41,594 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/4a06c7a70f7a41cb91b3d3034f576d91; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678805680646; access_time=1678805679824; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 14:54:41,594 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/c51a32c3cf3e4f978bd61249edf7b8e2_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678805681496; access_time=1678805680682; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-14 14:54:41,594 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/ea92b06781dc4c22a070f396fb2bb346; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678805679799; access_time=1678805678980; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 14:54:41,597 DEBUG [Listener at localhost.localdomain/44261] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-03-14 14:54:41,600 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:57960, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-03-14 14:54:41,601 INFO [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41317] regionserver.RSRpcServices(1662): Compacting testGetAfterCompaction,,1678805676849.0bcef87a6b6438389196033f1bfd1555. 2023-03-14 14:54:41,601 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41317] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 2 compacting, 0 eligible, 16 blocking 2023-03-14 14:54:41,601 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41317] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-03-14 14:54:41,601 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41317] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-03-14 14:54:41,601 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=41317] regionserver.CompactSplit(415): Not compacting testGetAfterCompaction,,1678805676849.0bcef87a6b6438389196033f1bfd1555. because compaction request was cancelled 2023-03-14 14:54:41,653 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/4a06c7a70f7a41cb91b3d3034f576d91; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678805680646; access_time=1678805679824; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 14:54:41,653 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/c51a32c3cf3e4f978bd61249edf7b8e2_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678805681496; access_time=1678805680682; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-14 14:54:41,653 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/ea92b06781dc4c22a070f396fb2bb346; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678805679799; access_time=1678805678980; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 14:54:41,704 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/4a06c7a70f7a41cb91b3d3034f576d91; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678805680646; access_time=1678805679824; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 14:54:41,704 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/c51a32c3cf3e4f978bd61249edf7b8e2_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678805681496; access_time=1678805680682; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-14 14:54:41,704 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/ea92b06781dc4c22a070f396fb2bb346; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678805679799; access_time=1678805678980; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 14:54:41,755 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/4a06c7a70f7a41cb91b3d3034f576d91; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678805680646; access_time=1678805679824; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 14:54:41,755 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/c51a32c3cf3e4f978bd61249edf7b8e2_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678805681496; access_time=1678805680682; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-14 14:54:41,755 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/ea92b06781dc4c22a070f396fb2bb346; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678805679799; access_time=1678805678980; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 14:54:41,807 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/4a06c7a70f7a41cb91b3d3034f576d91; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678805680646; access_time=1678805679824; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 14:54:41,807 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/c51a32c3cf3e4f978bd61249edf7b8e2_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678805681496; access_time=1678805680682; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-14 14:54:41,807 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/ea92b06781dc4c22a070f396fb2bb346; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678805679799; access_time=1678805678980; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 14:54:41,859 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/4a06c7a70f7a41cb91b3d3034f576d91; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678805680646; access_time=1678805679824; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 14:54:41,859 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/c51a32c3cf3e4f978bd61249edf7b8e2_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678805681496; access_time=1678805680682; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-14 14:54:41,859 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/ea92b06781dc4c22a070f396fb2bb346; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678805679799; access_time=1678805678980; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 14:54:41,911 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/4a06c7a70f7a41cb91b3d3034f576d91; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678805680646; access_time=1678805679824; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 14:54:41,911 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/c51a32c3cf3e4f978bd61249edf7b8e2_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678805681496; access_time=1678805680682; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-14 14:54:41,911 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/ea92b06781dc4c22a070f396fb2bb346; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678805679799; access_time=1678805678980; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 14:54:41,963 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/4a06c7a70f7a41cb91b3d3034f576d91; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678805680646; access_time=1678805679824; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 14:54:41,963 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/c51a32c3cf3e4f978bd61249edf7b8e2_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678805681496; access_time=1678805680682; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-14 14:54:41,963 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/ea92b06781dc4c22a070f396fb2bb346; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678805679799; access_time=1678805678980; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 14:54:42,015 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/4a06c7a70f7a41cb91b3d3034f576d91; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678805680646; access_time=1678805679824; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 14:54:42,015 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/c51a32c3cf3e4f978bd61249edf7b8e2_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678805681496; access_time=1678805680682; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-14 14:54:42,015 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/ea92b06781dc4c22a070f396fb2bb346; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678805679799; access_time=1678805678980; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 14:54:42,067 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/4a06c7a70f7a41cb91b3d3034f576d91; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678805680646; access_time=1678805679824; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 14:54:42,067 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/c51a32c3cf3e4f978bd61249edf7b8e2_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678805681496; access_time=1678805680682; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-14 14:54:42,067 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/ea92b06781dc4c22a070f396fb2bb346; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678805679799; access_time=1678805678980; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 14:54:42,119 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/4a06c7a70f7a41cb91b3d3034f576d91; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678805680646; access_time=1678805679824; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 14:54:42,119 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/c51a32c3cf3e4f978bd61249edf7b8e2_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678805681496; access_time=1678805680682; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-14 14:54:42,119 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/ea92b06781dc4c22a070f396fb2bb346; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678805679799; access_time=1678805678980; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 14:54:42,171 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/4a06c7a70f7a41cb91b3d3034f576d91; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678805680646; access_time=1678805679824; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 14:54:42,171 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/c51a32c3cf3e4f978bd61249edf7b8e2_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678805681496; access_time=1678805680682; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-14 14:54:42,171 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/ea92b06781dc4c22a070f396fb2bb346; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678805679799; access_time=1678805678980; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 14:54:42,223 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/4a06c7a70f7a41cb91b3d3034f576d91; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678805680646; access_time=1678805679824; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 14:54:42,223 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/c51a32c3cf3e4f978bd61249edf7b8e2_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678805681496; access_time=1678805680682; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-14 14:54:42,224 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/ea92b06781dc4c22a070f396fb2bb346; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678805679799; access_time=1678805678980; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 14:54:42,275 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/4a06c7a70f7a41cb91b3d3034f576d91; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678805680646; access_time=1678805679824; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 14:54:42,275 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/c51a32c3cf3e4f978bd61249edf7b8e2_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678805681496; access_time=1678805680682; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-14 14:54:42,276 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/ea92b06781dc4c22a070f396fb2bb346; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678805679799; access_time=1678805678980; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 14:54:42,327 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/4a06c7a70f7a41cb91b3d3034f576d91; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678805680646; access_time=1678805679824; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 14:54:42,328 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/c51a32c3cf3e4f978bd61249edf7b8e2_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678805681496; access_time=1678805680682; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-14 14:54:42,328 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/ea92b06781dc4c22a070f396fb2bb346; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678805679799; access_time=1678805678980; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 14:54:42,380 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/4a06c7a70f7a41cb91b3d3034f576d91; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678805680646; access_time=1678805679824; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 14:54:42,380 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/c51a32c3cf3e4f978bd61249edf7b8e2_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1678805681496; access_time=1678805680682; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-03-14 14:54:42,380 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/ea92b06781dc4c22a070f396fb2bb346; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678805679799; access_time=1678805678980; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 14:54:42,397 DEBUG [RS:0;jenkins-hbase20:41317-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/.tmp/f1/b09c2ea2954f49058b3ed46c5acf5e0d as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/b09c2ea2954f49058b3ed46c5acf5e0d 2023-03-14 14:54:42,404 INFO [RS:0;jenkins-hbase20:41317-longCompactions-0] regionserver.HStore(1652): Completed compaction of 2 file(s) in 0bcef87a6b6438389196033f1bfd1555/f1 of 0bcef87a6b6438389196033f1bfd1555 into b09c2ea2954f49058b3ed46c5acf5e0d(size=5.1 K), total size for store is 10.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-14 14:54:42,404 DEBUG [RS:0;jenkins-hbase20:41317-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 0bcef87a6b6438389196033f1bfd1555: 2023-03-14 14:54:42,404 INFO [RS:0;jenkins-hbase20:41317-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testGetAfterCompaction,,1678805676849.0bcef87a6b6438389196033f1bfd1555., storeName=f1, fileCount=2, fileSize=10.0 K (4.9 K, 5.1 K), priority=2, time=1678805681557; duration=0sec 2023-03-14 14:54:42,404 DEBUG [RS:0;jenkins-hbase20:41317-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-14 14:54:42,414 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/4a06c7a70f7a41cb91b3d3034f576d91, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/c51a32c3cf3e4f978bd61249edf7b8e2_SeqId_12_] to archive 2023-03-14 14:54:42,415 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 14:54:42,418 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/4a06c7a70f7a41cb91b3d3034f576d91 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/4a06c7a70f7a41cb91b3d3034f576d91 2023-03-14 14:54:42,420 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/c51a32c3cf3e4f978bd61249edf7b8e2_SeqId_12_ to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/c51a32c3cf3e4f978bd61249edf7b8e2_SeqId_12_ 2023-03-14 14:54:42,431 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/b09c2ea2954f49058b3ed46c5acf5e0d; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1678805682384; access_time=1678805681562; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 14:54:42,431 INFO [Listener at localhost.localdomain/44261] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/ea92b06781dc4c22a070f396fb2bb346; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1678805679799; access_time=1678805678980; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-03-14 14:54:42,557 INFO [Listener at localhost.localdomain/44261] client.HBaseAdmin$15(890): Started disable of testGetAfterCompaction 2023-03-14 14:54:42,562 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testGetAfterCompaction 2023-03-14 14:54:42,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure2.ProcedureExecutor(1029): Stored pid=75, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testGetAfterCompaction 2023-03-14 14:54:42,574 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678805682573"}]},"ts":"1678805682573"} 2023-03-14 14:54:42,575 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLING in hbase:meta 2023-03-14 14:54:42,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-03-14 14:54:42,576 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testGetAfterCompaction to state=DISABLING 2023-03-14 14:54:42,577 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=0bcef87a6b6438389196033f1bfd1555, UNASSIGN}] 2023-03-14 14:54:42,578 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=0bcef87a6b6438389196033f1bfd1555, UNASSIGN 2023-03-14 14:54:42,578 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=0bcef87a6b6438389196033f1bfd1555, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:42,578 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1678805676849.0bcef87a6b6438389196033f1bfd1555.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1678805682578"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1678805682578"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678805682578"}]},"ts":"1678805682578"} 2023-03-14 14:54:42,580 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; CloseRegionProcedure 0bcef87a6b6438389196033f1bfd1555, server=jenkins-hbase20.apache.org,41317,1678805580877}] 2023-03-14 14:54:42,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-03-14 14:54:42,732 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 0bcef87a6b6438389196033f1bfd1555 2023-03-14 14:54:42,732 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 0bcef87a6b6438389196033f1bfd1555, disabling compactions & flushes 2023-03-14 14:54:42,732 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1678805676849.0bcef87a6b6438389196033f1bfd1555. 2023-03-14 14:54:42,732 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1678805676849.0bcef87a6b6438389196033f1bfd1555. 2023-03-14 14:54:42,732 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1678805676849.0bcef87a6b6438389196033f1bfd1555. after waiting 0 ms 2023-03-14 14:54:42,732 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1678805676849.0bcef87a6b6438389196033f1bfd1555. 2023-03-14 14:54:42,742 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-03-14 14:54:42,744 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-03-14 14:54:42,745 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1678805676849.0bcef87a6b6438389196033f1bfd1555. 2023-03-14 14:54:42,745 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 0bcef87a6b6438389196033f1bfd1555: 2023-03-14 14:54:42,746 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 0bcef87a6b6438389196033f1bfd1555 2023-03-14 14:54:42,747 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=0bcef87a6b6438389196033f1bfd1555, regionState=CLOSED 2023-03-14 14:54:42,747 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1678805676849.0bcef87a6b6438389196033f1bfd1555.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1678805682747"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678805682747"}]},"ts":"1678805682747"} 2023-03-14 14:54:42,749 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-03-14 14:54:42,749 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; CloseRegionProcedure 0bcef87a6b6438389196033f1bfd1555, server=jenkins-hbase20.apache.org,41317,1678805580877 in 169 msec 2023-03-14 14:54:42,750 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=75 2023-03-14 14:54:42,750 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=75, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=0bcef87a6b6438389196033f1bfd1555, UNASSIGN in 172 msec 2023-03-14 14:54:42,751 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678805682751"}]},"ts":"1678805682751"} 2023-03-14 14:54:42,751 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLED in hbase:meta 2023-03-14 14:54:42,752 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testGetAfterCompaction to state=DISABLED 2023-03-14 14:54:42,754 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=75, state=SUCCESS; DisableTableProcedure table=testGetAfterCompaction in 189 msec 2023-03-14 14:54:42,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-03-14 14:54:42,879 INFO [Listener at localhost.localdomain/44261] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testGetAfterCompaction, procId: 75 completed 2023-03-14 14:54:42,887 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testGetAfterCompaction 2023-03-14 14:54:42,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testGetAfterCompaction 2023-03-14 14:54:42,900 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-03-14 14:54:42,902 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=78, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-03-14 14:54:42,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=78 2023-03-14 14:54:42,905 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555 2023-03-14 14:54:42,906 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1, FileablePath, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/recovered.edits] 2023-03-14 14:54:42,909 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/b09c2ea2954f49058b3ed46c5acf5e0d to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/b09c2ea2954f49058b3ed46c5acf5e0d 2023-03-14 14:54:42,911 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/ea92b06781dc4c22a070f396fb2bb346 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/f1/ea92b06781dc4c22a070f396fb2bb346 2023-03-14 14:54:42,913 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/recovered.edits/15.seqid to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555/recovered.edits/15.seqid 2023-03-14 14:54:42,913 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/default/testGetAfterCompaction/0bcef87a6b6438389196033f1bfd1555 2023-03-14 14:54:42,913 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-03-14 14:54:42,914 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-03-14 14:54:42,914 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1] 2023-03-14 14:54:42,918 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230314eabab151381d4344b7d83ff27dbba497 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230314eabab151381d4344b7d83ff27dbba497 2023-03-14 14:54:42,918 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-03-14 14:54:42,921 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=78, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-03-14 14:54:42,940 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testGetAfterCompaction from hbase:meta 2023-03-14 14:54:42,942 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testGetAfterCompaction' descriptor. 2023-03-14 14:54:42,943 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=78, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-03-14 14:54:42,943 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testGetAfterCompaction' from region states. 2023-03-14 14:54:42,943 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction,,1678805676849.0bcef87a6b6438389196033f1bfd1555.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1678805682943"}]},"ts":"9223372036854775807"} 2023-03-14 14:54:42,945 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-03-14 14:54:42,945 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 0bcef87a6b6438389196033f1bfd1555, NAME => 'testGetAfterCompaction,,1678805676849.0bcef87a6b6438389196033f1bfd1555.', STARTKEY => '', ENDKEY => ''}] 2023-03-14 14:54:42,945 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testGetAfterCompaction' as deleted. 2023-03-14 14:54:42,945 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1678805682945"}]},"ts":"9223372036854775807"} 2023-03-14 14:54:42,946 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testGetAfterCompaction state from META 2023-03-14 14:54:42,948 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=78, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-03-14 14:54:42,948 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; DeleteTableProcedure table=testGetAfterCompaction in 58 msec 2023-03-14 14:54:43,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=78 2023-03-14 14:54:43,005 INFO [Listener at localhost.localdomain/44261] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testGetAfterCompaction, procId: 78 completed 2023-03-14 14:54:43,021 INFO [Listener at localhost.localdomain/44261] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=236 (was 249), OpenFileDescriptor=597 (was 636), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=161 (was 175), ProcessCount=170 (was 170), AvailableMemoryMB=12357 (was 12384) 2023-03-14 14:54:43,034 INFO [Listener at localhost.localdomain/44261] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=236, OpenFileDescriptor=597, MaxFileDescriptor=60000, SystemLoadAverage=161, ProcessCount=170, AvailableMemoryMB=12357 2023-03-14 14:54:43,037 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-03-14 14:54:43,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testCompactionWithHFileLink 2023-03-14 14:54:43,040 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_PRE_OPERATION 2023-03-14 14:54:43,040 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testCompactionWithHFileLink" procId is: 79 2023-03-14 14:54:43,041 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-14 14:54:43,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-03-14 14:54:43,044 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f 2023-03-14 14:54:43,044 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2 2023-03-14 14:54:43,044 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d 2023-03-14 14:54:43,044 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f empty. 2023-03-14 14:54:43,045 DEBUG [HFileArchiver-14] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2 empty. 2023-03-14 14:54:43,045 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d empty. 2023-03-14 14:54:43,045 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f 2023-03-14 14:54:43,045 DEBUG [HFileArchiver-14] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2 2023-03-14 14:54:43,045 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d 2023-03-14 14:54:43,045 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testCompactionWithHFileLink regions 2023-03-14 14:54:43,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-03-14 14:54:43,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-03-14 14:54:43,457 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-03-14 14:54:43,460 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(7675): creating {ENCODED => 541dfbe822716da662f3a573a64aa05f, NAME => 'testCompactionWithHFileLink,,1678805683037.541dfbe822716da662f3a573a64aa05f.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp 2023-03-14 14:54:43,461 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(7675): creating {ENCODED => d03921af574c9e368e124258e08ab95d, NAME => 'testCompactionWithHFileLink,2,1678805683037.d03921af574c9e368e124258e08ab95d.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp 2023-03-14 14:54:43,462 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(7675): creating {ENCODED => 46b57114435577599b693b836e0ad8d2, NAME => 'testCompactionWithHFileLink,1,1678805683037.46b57114435577599b693b836e0ad8d2.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp 2023-03-14 14:54:43,470 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1678805683037.46b57114435577599b693b836e0ad8d2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 14:54:43,470 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1678805683037.541dfbe822716da662f3a573a64aa05f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 14:54:43,470 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1604): Closing 46b57114435577599b693b836e0ad8d2, disabling compactions & flushes 2023-03-14 14:54:43,470 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1604): Closing 541dfbe822716da662f3a573a64aa05f, disabling compactions & flushes 2023-03-14 14:54:43,470 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1678805683037.46b57114435577599b693b836e0ad8d2. 2023-03-14 14:54:43,471 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1678805683037.541dfbe822716da662f3a573a64aa05f. 2023-03-14 14:54:43,471 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1678805683037.46b57114435577599b693b836e0ad8d2. 2023-03-14 14:54:43,471 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1678805683037.541dfbe822716da662f3a573a64aa05f. 2023-03-14 14:54:43,471 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1678805683037.46b57114435577599b693b836e0ad8d2. after waiting 0 ms 2023-03-14 14:54:43,471 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1678805683037.541dfbe822716da662f3a573a64aa05f. after waiting 0 ms 2023-03-14 14:54:43,471 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1678805683037.46b57114435577599b693b836e0ad8d2. 2023-03-14 14:54:43,471 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1678805683037.541dfbe822716da662f3a573a64aa05f. 2023-03-14 14:54:43,471 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1678805683037.46b57114435577599b693b836e0ad8d2. 2023-03-14 14:54:43,471 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1678805683037.541dfbe822716da662f3a573a64aa05f. 2023-03-14 14:54:43,471 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1558): Region close journal for 46b57114435577599b693b836e0ad8d2: 2023-03-14 14:54:43,471 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1558): Region close journal for 541dfbe822716da662f3a573a64aa05f: 2023-03-14 14:54:43,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-03-14 14:54:43,871 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1678805683037.d03921af574c9e368e124258e08ab95d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 14:54:43,872 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1604): Closing d03921af574c9e368e124258e08ab95d, disabling compactions & flushes 2023-03-14 14:54:43,872 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1678805683037.d03921af574c9e368e124258e08ab95d. 2023-03-14 14:54:43,872 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1678805683037.d03921af574c9e368e124258e08ab95d. 2023-03-14 14:54:43,872 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1678805683037.d03921af574c9e368e124258e08ab95d. after waiting 0 ms 2023-03-14 14:54:43,872 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1678805683037.d03921af574c9e368e124258e08ab95d. 2023-03-14 14:54:43,872 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1678805683037.d03921af574c9e368e124258e08ab95d. 2023-03-14 14:54:43,872 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1558): Region close journal for d03921af574c9e368e124258e08ab95d: 2023-03-14 14:54:43,878 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ADD_TO_META 2023-03-14 14:54:43,880 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1678805683037.46b57114435577599b693b836e0ad8d2.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678805683880"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678805683880"}]},"ts":"1678805683880"} 2023-03-14 14:54:43,880 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1678805683037.541dfbe822716da662f3a573a64aa05f.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678805683880"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678805683880"}]},"ts":"1678805683880"} 2023-03-14 14:54:43,880 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1678805683037.d03921af574c9e368e124258e08ab95d.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678805683880"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678805683880"}]},"ts":"1678805683880"} 2023-03-14 14:54:43,882 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-03-14 14:54:43,883 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-14 14:54:43,883 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678805683883"}]},"ts":"1678805683883"} 2023-03-14 14:54:43,885 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-03-14 14:54:43,890 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=541dfbe822716da662f3a573a64aa05f, ASSIGN}, {pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=46b57114435577599b693b836e0ad8d2, ASSIGN}, {pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=d03921af574c9e368e124258e08ab95d, ASSIGN}] 2023-03-14 14:54:43,893 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=541dfbe822716da662f3a573a64aa05f, ASSIGN 2023-03-14 14:54:43,893 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=d03921af574c9e368e124258e08ab95d, ASSIGN 2023-03-14 14:54:43,893 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=46b57114435577599b693b836e0ad8d2, ASSIGN 2023-03-14 14:54:43,894 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=541dfbe822716da662f3a573a64aa05f, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,41317,1678805580877; forceNewPlan=false, retain=false 2023-03-14 14:54:43,894 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=d03921af574c9e368e124258e08ab95d, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,41317,1678805580877; forceNewPlan=false, retain=false 2023-03-14 14:54:43,894 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=46b57114435577599b693b836e0ad8d2, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,41317,1678805580877; forceNewPlan=false, retain=false 2023-03-14 14:54:44,048 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=541dfbe822716da662f3a573a64aa05f, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:44,048 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=d03921af574c9e368e124258e08ab95d, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:44,049 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1678805683037.541dfbe822716da662f3a573a64aa05f.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678805684048"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1678805684048"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678805684048"}]},"ts":"1678805684048"} 2023-03-14 14:54:44,048 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=46b57114435577599b693b836e0ad8d2, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:44,049 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1678805683037.d03921af574c9e368e124258e08ab95d.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678805684048"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1678805684048"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678805684048"}]},"ts":"1678805684048"} 2023-03-14 14:54:44,049 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1678805683037.46b57114435577599b693b836e0ad8d2.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678805684048"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1678805684048"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678805684048"}]},"ts":"1678805684048"} 2023-03-14 14:54:44,052 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=83, ppid=80, state=RUNNABLE; OpenRegionProcedure 541dfbe822716da662f3a573a64aa05f, server=jenkins-hbase20.apache.org,41317,1678805580877}] 2023-03-14 14:54:44,054 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=84, ppid=82, state=RUNNABLE; OpenRegionProcedure d03921af574c9e368e124258e08ab95d, server=jenkins-hbase20.apache.org,41317,1678805580877}] 2023-03-14 14:54:44,058 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=81, state=RUNNABLE; OpenRegionProcedure 46b57114435577599b693b836e0ad8d2, server=jenkins-hbase20.apache.org,41317,1678805580877}] 2023-03-14 14:54:44,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-03-14 14:54:44,214 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,2,1678805683037.d03921af574c9e368e124258e08ab95d. 2023-03-14 14:54:44,214 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d03921af574c9e368e124258e08ab95d, NAME => 'testCompactionWithHFileLink,2,1678805683037.d03921af574c9e368e124258e08ab95d.', STARTKEY => '2', ENDKEY => ''} 2023-03-14 14:54:44,215 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink d03921af574c9e368e124258e08ab95d 2023-03-14 14:54:44,215 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1678805683037.d03921af574c9e368e124258e08ab95d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 14:54:44,215 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for d03921af574c9e368e124258e08ab95d 2023-03-14 14:54:44,215 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for d03921af574c9e368e124258e08ab95d 2023-03-14 14:54:44,218 INFO [StoreOpener-d03921af574c9e368e124258e08ab95d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region d03921af574c9e368e124258e08ab95d 2023-03-14 14:54:44,221 DEBUG [StoreOpener-d03921af574c9e368e124258e08ab95d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family1 2023-03-14 14:54:44,221 DEBUG [StoreOpener-d03921af574c9e368e124258e08ab95d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family1 2023-03-14 14:54:44,222 INFO [StoreOpener-d03921af574c9e368e124258e08ab95d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d03921af574c9e368e124258e08ab95d columnFamilyName family1 2023-03-14 14:54:44,224 INFO [StoreOpener-d03921af574c9e368e124258e08ab95d-1] regionserver.HStore(310): Store=d03921af574c9e368e124258e08ab95d/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 14:54:44,225 INFO [StoreOpener-d03921af574c9e368e124258e08ab95d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region d03921af574c9e368e124258e08ab95d 2023-03-14 14:54:44,227 DEBUG [StoreOpener-d03921af574c9e368e124258e08ab95d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family2 2023-03-14 14:54:44,227 DEBUG [StoreOpener-d03921af574c9e368e124258e08ab95d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family2 2023-03-14 14:54:44,227 INFO [StoreOpener-d03921af574c9e368e124258e08ab95d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d03921af574c9e368e124258e08ab95d columnFamilyName family2 2023-03-14 14:54:44,228 INFO [StoreOpener-d03921af574c9e368e124258e08ab95d-1] regionserver.HStore(310): Store=d03921af574c9e368e124258e08ab95d/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 14:54:44,230 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d 2023-03-14 14:54:44,230 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d 2023-03-14 14:54:44,232 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-14 14:54:44,234 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for d03921af574c9e368e124258e08ab95d 2023-03-14 14:54:44,236 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-14 14:54:44,236 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened d03921af574c9e368e124258e08ab95d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64826243, jitterRate=-0.03401370346546173}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-14 14:54:44,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for d03921af574c9e368e124258e08ab95d: 2023-03-14 14:54:44,237 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,2,1678805683037.d03921af574c9e368e124258e08ab95d., pid=84, masterSystemTime=1678805684208 2023-03-14 14:54:44,239 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,2,1678805683037.d03921af574c9e368e124258e08ab95d. 2023-03-14 14:54:44,239 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,2,1678805683037.d03921af574c9e368e124258e08ab95d. 2023-03-14 14:54:44,239 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,,1678805683037.541dfbe822716da662f3a573a64aa05f. 2023-03-14 14:54:44,239 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 541dfbe822716da662f3a573a64aa05f, NAME => 'testCompactionWithHFileLink,,1678805683037.541dfbe822716da662f3a573a64aa05f.', STARTKEY => '', ENDKEY => '1'} 2023-03-14 14:54:44,239 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=d03921af574c9e368e124258e08ab95d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:44,239 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 541dfbe822716da662f3a573a64aa05f 2023-03-14 14:54:44,239 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1678805683037.541dfbe822716da662f3a573a64aa05f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 14:54:44,239 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1678805683037.d03921af574c9e368e124258e08ab95d.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678805684239"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1678805684239"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678805684239"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678805684239"}]},"ts":"1678805684239"} 2023-03-14 14:54:44,239 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 541dfbe822716da662f3a573a64aa05f 2023-03-14 14:54:44,240 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 541dfbe822716da662f3a573a64aa05f 2023-03-14 14:54:44,241 INFO [StoreOpener-541dfbe822716da662f3a573a64aa05f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 541dfbe822716da662f3a573a64aa05f 2023-03-14 14:54:44,243 DEBUG [StoreOpener-541dfbe822716da662f3a573a64aa05f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1 2023-03-14 14:54:44,243 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=84, resume processing ppid=82 2023-03-14 14:54:44,243 DEBUG [StoreOpener-541dfbe822716da662f3a573a64aa05f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1 2023-03-14 14:54:44,243 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=84, ppid=82, state=SUCCESS; OpenRegionProcedure d03921af574c9e368e124258e08ab95d, server=jenkins-hbase20.apache.org,41317,1678805580877 in 187 msec 2023-03-14 14:54:44,244 INFO [StoreOpener-541dfbe822716da662f3a573a64aa05f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 541dfbe822716da662f3a573a64aa05f columnFamilyName family1 2023-03-14 14:54:44,244 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=d03921af574c9e368e124258e08ab95d, ASSIGN in 353 msec 2023-03-14 14:54:44,245 INFO [StoreOpener-541dfbe822716da662f3a573a64aa05f-1] regionserver.HStore(310): Store=541dfbe822716da662f3a573a64aa05f/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 14:54:44,245 INFO [StoreOpener-541dfbe822716da662f3a573a64aa05f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 541dfbe822716da662f3a573a64aa05f 2023-03-14 14:54:44,247 DEBUG [StoreOpener-541dfbe822716da662f3a573a64aa05f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family2 2023-03-14 14:54:44,247 DEBUG [StoreOpener-541dfbe822716da662f3a573a64aa05f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family2 2023-03-14 14:54:44,248 INFO [StoreOpener-541dfbe822716da662f3a573a64aa05f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 541dfbe822716da662f3a573a64aa05f columnFamilyName family2 2023-03-14 14:54:44,249 INFO [StoreOpener-541dfbe822716da662f3a573a64aa05f-1] regionserver.HStore(310): Store=541dfbe822716da662f3a573a64aa05f/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 14:54:44,250 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f 2023-03-14 14:54:44,251 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f 2023-03-14 14:54:44,252 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-14 14:54:44,253 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 541dfbe822716da662f3a573a64aa05f 2023-03-14 14:54:44,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-14 14:54:44,256 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 541dfbe822716da662f3a573a64aa05f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75059404, jitterRate=0.11847227811813354}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-14 14:54:44,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 541dfbe822716da662f3a573a64aa05f: 2023-03-14 14:54:44,256 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,,1678805683037.541dfbe822716da662f3a573a64aa05f., pid=83, masterSystemTime=1678805684208 2023-03-14 14:54:44,258 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,,1678805683037.541dfbe822716da662f3a573a64aa05f. 2023-03-14 14:54:44,258 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,,1678805683037.541dfbe822716da662f3a573a64aa05f. 2023-03-14 14:54:44,258 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,1,1678805683037.46b57114435577599b693b836e0ad8d2. 2023-03-14 14:54:44,258 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 46b57114435577599b693b836e0ad8d2, NAME => 'testCompactionWithHFileLink,1,1678805683037.46b57114435577599b693b836e0ad8d2.', STARTKEY => '1', ENDKEY => '2'} 2023-03-14 14:54:44,258 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=541dfbe822716da662f3a573a64aa05f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:44,258 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1678805683037.541dfbe822716da662f3a573a64aa05f.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678805684258"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1678805684258"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678805684258"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678805684258"}]},"ts":"1678805684258"} 2023-03-14 14:54:44,258 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 46b57114435577599b693b836e0ad8d2 2023-03-14 14:54:44,258 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1678805683037.46b57114435577599b693b836e0ad8d2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 14:54:44,259 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 46b57114435577599b693b836e0ad8d2 2023-03-14 14:54:44,259 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 46b57114435577599b693b836e0ad8d2 2023-03-14 14:54:44,260 INFO [StoreOpener-46b57114435577599b693b836e0ad8d2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 46b57114435577599b693b836e0ad8d2 2023-03-14 14:54:44,261 DEBUG [StoreOpener-46b57114435577599b693b836e0ad8d2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1 2023-03-14 14:54:44,261 DEBUG [StoreOpener-46b57114435577599b693b836e0ad8d2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1 2023-03-14 14:54:44,261 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=83, resume processing ppid=80 2023-03-14 14:54:44,262 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=83, ppid=80, state=SUCCESS; OpenRegionProcedure 541dfbe822716da662f3a573a64aa05f, server=jenkins-hbase20.apache.org,41317,1678805580877 in 208 msec 2023-03-14 14:54:44,262 INFO [StoreOpener-46b57114435577599b693b836e0ad8d2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 46b57114435577599b693b836e0ad8d2 columnFamilyName family1 2023-03-14 14:54:44,262 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=80, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=541dfbe822716da662f3a573a64aa05f, ASSIGN in 374 msec 2023-03-14 14:54:44,263 INFO [StoreOpener-46b57114435577599b693b836e0ad8d2-1] regionserver.HStore(310): Store=46b57114435577599b693b836e0ad8d2/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 14:54:44,263 INFO [StoreOpener-46b57114435577599b693b836e0ad8d2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 46b57114435577599b693b836e0ad8d2 2023-03-14 14:54:44,264 DEBUG [StoreOpener-46b57114435577599b693b836e0ad8d2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family2 2023-03-14 14:54:44,264 DEBUG [StoreOpener-46b57114435577599b693b836e0ad8d2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family2 2023-03-14 14:54:44,265 INFO [StoreOpener-46b57114435577599b693b836e0ad8d2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 46b57114435577599b693b836e0ad8d2 columnFamilyName family2 2023-03-14 14:54:44,266 INFO [StoreOpener-46b57114435577599b693b836e0ad8d2-1] regionserver.HStore(310): Store=46b57114435577599b693b836e0ad8d2/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 14:54:44,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2 2023-03-14 14:54:44,267 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2 2023-03-14 14:54:44,268 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-14 14:54:44,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 46b57114435577599b693b836e0ad8d2 2023-03-14 14:54:44,270 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-14 14:54:44,271 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 46b57114435577599b693b836e0ad8d2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62036010, jitterRate=-0.07559141516685486}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-14 14:54:44,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 46b57114435577599b693b836e0ad8d2: 2023-03-14 14:54:44,271 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,1,1678805683037.46b57114435577599b693b836e0ad8d2., pid=85, masterSystemTime=1678805684208 2023-03-14 14:54:44,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,1,1678805683037.46b57114435577599b693b836e0ad8d2. 2023-03-14 14:54:44,272 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,1,1678805683037.46b57114435577599b693b836e0ad8d2. 2023-03-14 14:54:44,273 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=46b57114435577599b693b836e0ad8d2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:44,273 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1678805683037.46b57114435577599b693b836e0ad8d2.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678805684272"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1678805684272"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678805684272"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678805684272"}]},"ts":"1678805684272"} 2023-03-14 14:54:44,275 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=81 2023-03-14 14:54:44,275 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=81, state=SUCCESS; OpenRegionProcedure 46b57114435577599b693b836e0ad8d2, server=jenkins-hbase20.apache.org,41317,1678805580877 in 219 msec 2023-03-14 14:54:44,276 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=79 2023-03-14 14:54:44,276 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=46b57114435577599b693b836e0ad8d2, ASSIGN in 387 msec 2023-03-14 14:54:44,277 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-14 14:54:44,277 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678805684277"}]},"ts":"1678805684277"} 2023-03-14 14:54:44,278 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-03-14 14:54:44,279 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_POST_OPERATION 2023-03-14 14:54:44,280 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; CreateTableProcedure table=testCompactionWithHFileLink in 1.2420 sec 2023-03-14 14:54:45,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-03-14 14:54:45,153 INFO [Listener at localhost.localdomain/44261] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testCompactionWithHFileLink, procId: 79 completed 2023-03-14 14:54:45,167 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1678805683037.541dfbe822716da662f3a573a64aa05f. with WAL disabled. Data may be lost in the event of a crash. 2023-03-14 14:54:45,168 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1678805683037.46b57114435577599b693b836e0ad8d2. with WAL disabled. Data may be lost in the event of a crash. 2023-03-14 14:54:45,169 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1678805683037.d03921af574c9e368e124258e08ab95d. with WAL disabled. Data may be lost in the event of a crash. 2023-03-14 14:54:45,172 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:54:45,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-03-14 14:54:45,175 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-03-14 14:54:45,175 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:54:45,175 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-03-14 14:54:45,175 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-03-14 14:54:45,175 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 14:54:45,175 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-14 14:54:45,176 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:54:45,176 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:45,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:54:45,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:54:45,177 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:45,177 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:54:45,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-14 14:54:45,177 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 14:54:45,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:54:45,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-14 14:54:45,178 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-03-14 14:54:45,178 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-03-14 14:54:45,178 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-03-14 14:54:45,178 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:54:45,178 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-03-14 14:54:45,178 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1678805683037.d03921af574c9e368e124258e08ab95d. 2023-03-14 14:54:45,178 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1678805683037.46b57114435577599b693b836e0ad8d2. 2023-03-14 14:54:45,178 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1678805683037.46b57114435577599b693b836e0ad8d2. started... 2023-03-14 14:54:45,178 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-14 14:54:45,178 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:54:45,178 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1678805683037.d03921af574c9e368e124258e08ab95d. started... 2023-03-14 14:54:45,179 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 46b57114435577599b693b836e0ad8d2 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-14 14:54:45,178 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1678805683037.541dfbe822716da662f3a573a64aa05f. 2023-03-14 14:54:45,179 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1678805683037.541dfbe822716da662f3a573a64aa05f. started... 2023-03-14 14:54:45,179 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d03921af574c9e368e124258e08ab95d 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-14 14:54:45,180 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 541dfbe822716da662f3a573a64aa05f 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-14 14:54:45,600 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023031454adfebd63414c198bff0e938bfc1e87 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023031454adfebd63414c198bff0e938bfc1e87 2023-03-14 14:54:45,600 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230314b353e02f869a49458bca945e03232f09 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230314b353e02f869a49458bca945e03232f09 2023-03-14 14:54:45,601 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303140793053a07d1492b94e2f50baefaf1e0 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303140793053a07d1492b94e2f50baefaf1e0 2023-03-14 14:54:45,607 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/.tmp/family1/c9bf5b936237414485b321f354149a3f 2023-03-14 14:54:46,008 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/.tmp/family1/70e0f28062314487bee0b6ed2ce10d0b 2023-03-14 14:54:46,009 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/.tmp/family1/7bedf33c34414f65b99ef964dca782ad 2023-03-14 14:54:46,021 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230314f33f5277e1e343218385288838cf2e73 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230314f33f5277e1e343218385288838cf2e73 2023-03-14 14:54:46,098 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-03-14 14:54:46,427 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/.tmp/family2/f50ca180804e42159fa65ddb96403962 2023-03-14 14:54:46,435 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230314265d06ea88ef49fa8b4abd0ab50b8535 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230314265d06ea88ef49fa8b4abd0ab50b8535 2023-03-14 14:54:46,436 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230314270c91d86df24c9cafb1962842b0a97f to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230314270c91d86df24c9cafb1962842b0a97f 2023-03-14 14:54:46,437 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/.tmp/family1/c9bf5b936237414485b321f354149a3f as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1/c9bf5b936237414485b321f354149a3f 2023-03-14 14:54:46,443 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1/c9bf5b936237414485b321f354149a3f, entries=4, sequenceid=5, filesize=5.4 K 2023-03-14 14:54:46,444 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/.tmp/family2/f50ca180804e42159fa65ddb96403962 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family2/f50ca180804e42159fa65ddb96403962 2023-03-14 14:54:46,447 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family2/f50ca180804e42159fa65ddb96403962, entries=2, sequenceid=5, filesize=5.1 K 2023-03-14 14:54:46,448 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 46b57114435577599b693b836e0ad8d2 in 1269ms, sequenceid=5, compaction requested=false 2023-03-14 14:54:46,449 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 46b57114435577599b693b836e0ad8d2: 2023-03-14 14:54:46,449 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1678805683037.46b57114435577599b693b836e0ad8d2. 2023-03-14 14:54:46,449 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-14 14:54:46,842 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/.tmp/family2/3a131025d2344260a03875522668b04a 2023-03-14 14:54:46,842 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/.tmp/family2/a8d3d3d688f44d5c98b54f77a810edfb 2023-03-14 14:54:46,850 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/.tmp/family1/70e0f28062314487bee0b6ed2ce10d0b as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1/70e0f28062314487bee0b6ed2ce10d0b 2023-03-14 14:54:46,850 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/.tmp/family1/7bedf33c34414f65b99ef964dca782ad as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family1/7bedf33c34414f65b99ef964dca782ad 2023-03-14 14:54:46,856 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1/70e0f28062314487bee0b6ed2ce10d0b, entries=4, sequenceid=5, filesize=5.4 K 2023-03-14 14:54:46,857 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family1/7bedf33c34414f65b99ef964dca782ad, entries=4, sequenceid=5, filesize=5.4 K 2023-03-14 14:54:46,857 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/.tmp/family2/3a131025d2344260a03875522668b04a as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family2/3a131025d2344260a03875522668b04a 2023-03-14 14:54:46,858 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/.tmp/family2/a8d3d3d688f44d5c98b54f77a810edfb as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family2/a8d3d3d688f44d5c98b54f77a810edfb 2023-03-14 14:54:46,864 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family2/a8d3d3d688f44d5c98b54f77a810edfb, entries=2, sequenceid=5, filesize=5.1 K 2023-03-14 14:54:46,864 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family2/3a131025d2344260a03875522668b04a, entries=2, sequenceid=5, filesize=5.1 K 2023-03-14 14:54:46,865 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for d03921af574c9e368e124258e08ab95d in 1686ms, sequenceid=5, compaction requested=false 2023-03-14 14:54:46,865 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 541dfbe822716da662f3a573a64aa05f in 1685ms, sequenceid=5, compaction requested=false 2023-03-14 14:54:46,865 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d03921af574c9e368e124258e08ab95d: 2023-03-14 14:54:46,865 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 541dfbe822716da662f3a573a64aa05f: 2023-03-14 14:54:46,865 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1678805683037.541dfbe822716da662f3a573a64aa05f. 2023-03-14 14:54:46,865 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1678805683037.d03921af574c9e368e124258e08ab95d. 2023-03-14 14:54:46,865 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-14 14:54:46,866 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-14 14:54:46,866 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-14 14:54:46,866 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:46,866 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-03-14 14:54:46,866 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-03-14 14:54:46,867 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:46,867 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-14 14:54:46,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:46,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:46,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:46,867 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-14 14:54:46,867 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:54:46,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:46,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:46,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-14 14:54:46,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:46,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:46,869 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-03-14 14:54:46,869 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@ec53ebd[Count = 0] remaining members to acquire global barrier 2023-03-14 14:54:46,869 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-03-14 14:54:46,869 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-14 14:54:46,869 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-14 14:54:46,869 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-14 14:54:46,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-14 14:54:46,869 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-03-14 14:54:46,869 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-03-14 14:54:46,869 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:54:46,869 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:46,870 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:54:46,870 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:46,870 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-03-14 14:54:46,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:46,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:46,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:46,870 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:54:46,871 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-03-14 14:54:46,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:46,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:46,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-14 14:54:46,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:46,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:46,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-14 14:54:46,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:46,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:54:46,873 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-03-14 14:54:46,873 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-03-14 14:54:46,873 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:54:46,873 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:54:46,873 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-03-14 14:54:46,873 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:54:46,874 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 14:54:46,874 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 14:54:46,874 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:54:46,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 14:54:46,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:46,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:46,874 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 14:54:46,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 14:54:46,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:46,875 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:54:46,875 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:46,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:54:46,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-14 14:54:46,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 14:54:46,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:46,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-14 14:54:46,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:46,876 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:46,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:46,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-14 14:54:46,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:46,877 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:46,877 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:54:46,877 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-14 14:54:46,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:54:46,877 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-14 14:54:46,877 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:54:46,877 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:46,877 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-03-14 14:54:46,878 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:54:46,877 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:54:46,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:54:46,878 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-14 14:54:46,878 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-14 14:54:46,878 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 14:54:46,878 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-03-14 14:54:46,878 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:54:46,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:54:46,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:54:46,978 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:54:46,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:54:46,982 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1678805683037.541dfbe822716da662f3a573a64aa05f. with WAL disabled. Data may be lost in the event of a crash. 2023-03-14 14:54:46,982 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1678805683037.46b57114435577599b693b836e0ad8d2. with WAL disabled. Data may be lost in the event of a crash. 2023-03-14 14:54:46,982 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1678805683037.d03921af574c9e368e124258e08ab95d. with WAL disabled. Data may be lost in the event of a crash. 2023-03-14 14:54:46,987 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:54:46,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-03-14 14:54:46,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-03-14 14:54:46,990 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-03-14 14:54:46,990 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:54:46,990 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-03-14 14:54:46,990 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-03-14 14:54:46,991 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 14:54:46,991 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-14 14:54:46,992 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:54:46,992 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:46,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:54:46,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:54:46,993 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:46,993 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:54:46,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-14 14:54:46,993 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 14:54:46,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:54:46,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-14 14:54:46,994 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-03-14 14:54:46,994 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-03-14 14:54:46,994 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-03-14 14:54:46,994 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-03-14 14:54:46,994 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:54:46,994 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-03-14 14:54:46,995 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1678805683037.d03921af574c9e368e124258e08ab95d. 2023-03-14 14:54:46,995 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1678805683037.d03921af574c9e368e124258e08ab95d. started... 2023-03-14 14:54:46,995 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1678805683037.46b57114435577599b693b836e0ad8d2. 2023-03-14 14:54:46,995 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-14 14:54:46,995 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:54:46,995 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d03921af574c9e368e124258e08ab95d 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-14 14:54:46,995 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1678805683037.541dfbe822716da662f3a573a64aa05f. 2023-03-14 14:54:46,995 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1678805683037.541dfbe822716da662f3a573a64aa05f. started... 2023-03-14 14:54:46,995 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1678805683037.46b57114435577599b693b836e0ad8d2. started... 2023-03-14 14:54:46,995 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 541dfbe822716da662f3a573a64aa05f 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-14 14:54:46,995 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 46b57114435577599b693b836e0ad8d2 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-14 14:54:47,419 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303144f70f82c217d488083d264a4438a183c to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303144f70f82c217d488083d264a4438a183c 2023-03-14 14:54:47,419 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303145ee28b82bdc245389b68cc7d9e252743 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303145ee28b82bdc245389b68cc7d9e252743 2023-03-14 14:54:47,422 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023031409ce4a6ddfb84b438695750db282e007 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023031409ce4a6ddfb84b438695750db282e007 2023-03-14 14:54:47,826 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/.tmp/family1/25a93ba0de464a7680c159909c51660b 2023-03-14 14:54:47,826 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/.tmp/family1/a6062f3df98748bdabc1471e8d8f1031 2023-03-14 14:54:47,828 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/.tmp/family1/591c70d95e90448b9e60702762d6fe7b 2023-03-14 14:54:48,250 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-14 14:54:48,252 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303147f4ba9a482cf4d1da182ae7bd70c57a6 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303147f4ba9a482cf4d1da182ae7bd70c57a6 2023-03-14 14:54:48,252 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230314d6712bf865914adf9b8f5b3b39a2c79e to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230314d6712bf865914adf9b8f5b3b39a2c79e 2023-03-14 14:54:48,259 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303144bff8261664046c187eb07e2237022fe to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202303144bff8261664046c187eb07e2237022fe 2023-03-14 14:54:48,260 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/.tmp/family2/04bf20de187e447d8cd4c89e4ba37610 2023-03-14 14:54:48,265 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/.tmp/family1/591c70d95e90448b9e60702762d6fe7b as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1/591c70d95e90448b9e60702762d6fe7b 2023-03-14 14:54:48,268 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1/591c70d95e90448b9e60702762d6fe7b, entries=4, sequenceid=9, filesize=5.4 K 2023-03-14 14:54:48,269 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/.tmp/family2/04bf20de187e447d8cd4c89e4ba37610 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family2/04bf20de187e447d8cd4c89e4ba37610 2023-03-14 14:54:48,273 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family2/04bf20de187e447d8cd4c89e4ba37610, entries=2, sequenceid=9, filesize=5.1 K 2023-03-14 14:54:48,273 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 541dfbe822716da662f3a573a64aa05f in 1278ms, sequenceid=9, compaction requested=false 2023-03-14 14:54:48,273 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 541dfbe822716da662f3a573a64aa05f: 2023-03-14 14:54:48,273 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1678805683037.541dfbe822716da662f3a573a64aa05f. 2023-03-14 14:54:48,274 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-14 14:54:48,661 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/.tmp/family2/b01622885e094dce84b6378c5e6e9a6f 2023-03-14 14:54:48,665 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/.tmp/family2/a25e279e24aa4b70919faaa31a07769a 2023-03-14 14:54:48,673 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/.tmp/family1/a6062f3df98748bdabc1471e8d8f1031 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1/a6062f3df98748bdabc1471e8d8f1031 2023-03-14 14:54:48,674 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/.tmp/family1/25a93ba0de464a7680c159909c51660b as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family1/25a93ba0de464a7680c159909c51660b 2023-03-14 14:54:48,679 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1/a6062f3df98748bdabc1471e8d8f1031, entries=4, sequenceid=9, filesize=5.4 K 2023-03-14 14:54:48,679 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family1/25a93ba0de464a7680c159909c51660b, entries=4, sequenceid=9, filesize=5.4 K 2023-03-14 14:54:48,680 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/.tmp/family2/b01622885e094dce84b6378c5e6e9a6f as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family2/b01622885e094dce84b6378c5e6e9a6f 2023-03-14 14:54:48,680 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/.tmp/family2/a25e279e24aa4b70919faaa31a07769a as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family2/a25e279e24aa4b70919faaa31a07769a 2023-03-14 14:54:48,686 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family2/b01622885e094dce84b6378c5e6e9a6f, entries=2, sequenceid=9, filesize=5.1 K 2023-03-14 14:54:48,686 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family2/a25e279e24aa4b70919faaa31a07769a, entries=2, sequenceid=9, filesize=5.1 K 2023-03-14 14:54:48,687 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 46b57114435577599b693b836e0ad8d2 in 1692ms, sequenceid=9, compaction requested=false 2023-03-14 14:54:48,687 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for d03921af574c9e368e124258e08ab95d in 1692ms, sequenceid=9, compaction requested=false 2023-03-14 14:54:48,687 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 46b57114435577599b693b836e0ad8d2: 2023-03-14 14:54:48,687 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1678805683037.46b57114435577599b693b836e0ad8d2. 2023-03-14 14:54:48,687 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d03921af574c9e368e124258e08ab95d: 2023-03-14 14:54:48,687 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1678805683037.d03921af574c9e368e124258e08ab95d. 2023-03-14 14:54:48,687 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-14 14:54:48,687 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-14 14:54:48,687 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-14 14:54:48,687 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:48,687 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-03-14 14:54:48,687 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-03-14 14:54:48,689 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:48,689 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-14 14:54:48,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:48,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:48,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:48,689 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-14 14:54:48,689 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:54:48,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:48,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:48,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-14 14:54:48,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:48,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:48,690 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-03-14 14:54:48,691 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6ebd6222[Count = 0] remaining members to acquire global barrier 2023-03-14 14:54:48,691 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-03-14 14:54:48,691 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-14 14:54:48,691 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-14 14:54:48,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-14 14:54:48,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-14 14:54:48,691 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-03-14 14:54:48,691 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-03-14 14:54:48,691 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:54:48,691 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:48,692 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:54:48,692 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-03-14 14:54:48,692 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:48,692 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:54:48,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:48,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:48,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:48,692 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-03-14 14:54:48,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:48,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:48,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-14 14:54:48,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:48,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:48,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-14 14:54:48,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:48,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:54:48,695 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-03-14 14:54:48,695 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-03-14 14:54:48,695 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:54:48,695 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:54:48,695 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-03-14 14:54:48,695 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:54:48,696 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 14:54:48,696 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 14:54:48,696 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 14:54:48,696 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:54:48,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 14:54:48,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 14:54:48,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:48,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:48,697 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:54:48,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:54:48,697 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:48,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:48,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 14:54:48,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-14 14:54:48,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:48,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-14 14:54:48,698 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:48,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:48,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:48,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-14 14:54:48,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:48,700 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:48,700 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:54:48,700 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-14 14:54:48,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:54:48,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:54:48,700 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-03-14 14:54:48,700 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:54:48,700 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-14 14:54:48,700 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-03-14 14:54:48,700 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:54:48,700 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:54:48,700 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:48,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:54:48,701 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-14 14:54:48,701 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-03-14 14:54:48,701 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-14 14:54:48,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:54:48,701 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 14:54:48,701 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:54:48,801 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:54:48,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:54:48,805 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1678805683037.541dfbe822716da662f3a573a64aa05f. with WAL disabled. Data may be lost in the event of a crash. 2023-03-14 14:54:48,805 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1678805683037.46b57114435577599b693b836e0ad8d2. with WAL disabled. Data may be lost in the event of a crash. 2023-03-14 14:54:48,805 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1678805683037.d03921af574c9e368e124258e08ab95d. with WAL disabled. Data may be lost in the event of a crash. 2023-03-14 14:54:48,810 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:54:48,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-03-14 14:54:48,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-03-14 14:54:48,815 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-03-14 14:54:48,815 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:54:48,815 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-03-14 14:54:48,815 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-03-14 14:54:48,816 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 14:54:48,816 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-14 14:54:48,817 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:54:48,817 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:48,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:54:48,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:54:48,818 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:48,818 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:54:48,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-14 14:54:48,818 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 14:54:48,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:54:48,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-14 14:54:48,819 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-03-14 14:54:48,819 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-03-14 14:54:48,819 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-03-14 14:54:48,819 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-03-14 14:54:48,819 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:54:48,819 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-03-14 14:54:48,819 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1678805683037.d03921af574c9e368e124258e08ab95d. 2023-03-14 14:54:48,819 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1678805683037.46b57114435577599b693b836e0ad8d2. 2023-03-14 14:54:48,819 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1678805683037.46b57114435577599b693b836e0ad8d2. started... 2023-03-14 14:54:48,819 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-14 14:54:48,819 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:54:48,819 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1678805683037.d03921af574c9e368e124258e08ab95d. started... 2023-03-14 14:54:48,819 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 46b57114435577599b693b836e0ad8d2 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-14 14:54:48,819 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1678805683037.541dfbe822716da662f3a573a64aa05f. 2023-03-14 14:54:48,819 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d03921af574c9e368e124258e08ab95d 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-14 14:54:48,819 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1678805683037.541dfbe822716da662f3a573a64aa05f. started... 2023-03-14 14:54:48,820 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 541dfbe822716da662f3a573a64aa05f 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-14 14:54:48,848 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230314a5917ff88234474e908ccfc6684a0e94 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230314a5917ff88234474e908ccfc6684a0e94 2023-03-14 14:54:48,848 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230314d71ba2d46f4e4de689ca125a16b89c45 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230314d71ba2d46f4e4de689ca125a16b89c45 2023-03-14 14:54:49,249 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230314976e5048cf584ab8bdad3c00af0cd325 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230314976e5048cf584ab8bdad3c00af0cd325 2023-03-14 14:54:49,257 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/.tmp/family1/b19c3c6a9bf5422989ad34b1bd3dd634 2023-03-14 14:54:49,258 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/.tmp/family1/1b5ac87360aa4bb191cc4449750a7907 2023-03-14 14:54:49,654 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/.tmp/family1/0d78103959d84c55bf5fd402a71523ff 2023-03-14 14:54:49,666 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230314ec67fccb67af477e9088878826566c06 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230314ec67fccb67af477e9088878826566c06 2023-03-14 14:54:49,671 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303145a943fa5bcc34dcbb791de97f3d197d7 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303145a943fa5bcc34dcbb791de97f3d197d7 2023-03-14 14:54:49,671 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303145b6cbf9af4e542ad9fb96522f2d38b9d to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202303145b6cbf9af4e542ad9fb96522f2d38b9d 2023-03-14 14:54:49,837 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-03-14 14:54:50,072 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/.tmp/family2/9a13180cb0db4dbd970bf225dcab0e4c 2023-03-14 14:54:50,079 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/.tmp/family2/1628452bcbc044978e89d0017623b719 2023-03-14 14:54:50,079 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/.tmp/family2/55badc960cc24ee5ad7320c72ae33a8f 2023-03-14 14:54:50,083 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/.tmp/family1/0d78103959d84c55bf5fd402a71523ff as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family1/0d78103959d84c55bf5fd402a71523ff 2023-03-14 14:54:50,085 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/.tmp/family1/b19c3c6a9bf5422989ad34b1bd3dd634 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1/b19c3c6a9bf5422989ad34b1bd3dd634 2023-03-14 14:54:50,085 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/.tmp/family1/1b5ac87360aa4bb191cc4449750a7907 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1/1b5ac87360aa4bb191cc4449750a7907 2023-03-14 14:54:50,087 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family1/0d78103959d84c55bf5fd402a71523ff, entries=4, sequenceid=13, filesize=5.4 K 2023-03-14 14:54:50,088 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/.tmp/family2/9a13180cb0db4dbd970bf225dcab0e4c as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family2/9a13180cb0db4dbd970bf225dcab0e4c 2023-03-14 14:54:50,089 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1/b19c3c6a9bf5422989ad34b1bd3dd634, entries=4, sequenceid=13, filesize=5.4 K 2023-03-14 14:54:50,089 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1/1b5ac87360aa4bb191cc4449750a7907, entries=4, sequenceid=13, filesize=5.4 K 2023-03-14 14:54:50,090 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/.tmp/family2/1628452bcbc044978e89d0017623b719 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family2/1628452bcbc044978e89d0017623b719 2023-03-14 14:54:50,090 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/.tmp/family2/55badc960cc24ee5ad7320c72ae33a8f as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family2/55badc960cc24ee5ad7320c72ae33a8f 2023-03-14 14:54:50,092 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family2/9a13180cb0db4dbd970bf225dcab0e4c, entries=2, sequenceid=13, filesize=5.1 K 2023-03-14 14:54:50,095 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for d03921af574c9e368e124258e08ab95d in 1276ms, sequenceid=13, compaction requested=true 2023-03-14 14:54:50,095 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d03921af574c9e368e124258e08ab95d: 2023-03-14 14:54:50,095 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1678805683037.d03921af574c9e368e124258e08ab95d. 2023-03-14 14:54:50,095 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-14 14:54:50,096 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family2/55badc960cc24ee5ad7320c72ae33a8f, entries=2, sequenceid=13, filesize=5.1 K 2023-03-14 14:54:50,096 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family2/1628452bcbc044978e89d0017623b719, entries=2, sequenceid=13, filesize=5.1 K 2023-03-14 14:54:50,097 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 541dfbe822716da662f3a573a64aa05f in 1277ms, sequenceid=13, compaction requested=true 2023-03-14 14:54:50,097 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 46b57114435577599b693b836e0ad8d2 in 1278ms, sequenceid=13, compaction requested=true 2023-03-14 14:54:50,097 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 541dfbe822716da662f3a573a64aa05f: 2023-03-14 14:54:50,097 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 46b57114435577599b693b836e0ad8d2: 2023-03-14 14:54:50,097 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1678805683037.541dfbe822716da662f3a573a64aa05f. 2023-03-14 14:54:50,097 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1678805683037.46b57114435577599b693b836e0ad8d2. 2023-03-14 14:54:50,097 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-14 14:54:50,097 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-14 14:54:50,097 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-14 14:54:50,097 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:50,097 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-03-14 14:54:50,097 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-03-14 14:54:50,098 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:50,098 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-14 14:54:50,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:50,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:50,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:50,099 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-14 14:54:50,099 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:54:50,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:50,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:50,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-14 14:54:50,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:50,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:50,100 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-03-14 14:54:50,100 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@34186477[Count = 0] remaining members to acquire global barrier 2023-03-14 14:54:50,100 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-03-14 14:54:50,100 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-14 14:54:50,102 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-14 14:54:50,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-14 14:54:50,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-14 14:54:50,102 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-03-14 14:54:50,102 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-03-14 14:54:50,102 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:50,102 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:54:50,102 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:54:50,103 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-03-14 14:54:50,103 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:54:50,103 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-03-14 14:54:50,103 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:50,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:50,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:50,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:50,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:50,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:50,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-14 14:54:50,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:50,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:50,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-14 14:54:50,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:50,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:54:50,105 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-03-14 14:54:50,105 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-03-14 14:54:50,106 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:54:50,106 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:54:50,106 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-03-14 14:54:50,106 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:54:50,107 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 14:54:50,107 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 14:54:50,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 14:54:50,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:50,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:50,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 14:54:50,107 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:54:50,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 14:54:50,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:50,107 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:50,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:54:50,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:54:50,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-14 14:54:50,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 14:54:50,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:50,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-14 14:54:50,108 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:50,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:50,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:50,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-14 14:54:50,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:50,110 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:50,110 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:54:50,110 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-14 14:54:50,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:54:50,110 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:54:50,111 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-03-14 14:54:50,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:54:50,111 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-03-14 14:54:50,111 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:54:50,110 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:54:50,110 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-14 14:54:50,111 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:50,111 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-14 14:54:50,111 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-14 14:54:50,111 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 14:54:50,111 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-03-14 14:54:50,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:54:50,111 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:54:50,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:54:50,212 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:54:50,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:54:50,217 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1678805683037.541dfbe822716da662f3a573a64aa05f. with WAL disabled. Data may be lost in the event of a crash. 2023-03-14 14:54:50,218 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1678805683037.46b57114435577599b693b836e0ad8d2. with WAL disabled. Data may be lost in the event of a crash. 2023-03-14 14:54:50,218 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1678805683037.d03921af574c9e368e124258e08ab95d. with WAL disabled. Data may be lost in the event of a crash. 2023-03-14 14:54:50,223 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:54:50,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-03-14 14:54:50,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-03-14 14:54:50,225 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-03-14 14:54:50,225 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:54:50,225 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-03-14 14:54:50,225 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-03-14 14:54:50,225 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 14:54:50,226 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-14 14:54:50,226 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:54:50,226 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:50,226 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:54:50,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:54:50,227 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:50,227 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:54:50,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-14 14:54:50,227 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 14:54:50,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:54:50,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-14 14:54:50,228 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-03-14 14:54:50,228 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-03-14 14:54:50,228 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-03-14 14:54:50,228 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-03-14 14:54:50,228 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:54:50,228 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-03-14 14:54:50,228 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1678805683037.d03921af574c9e368e124258e08ab95d. 2023-03-14 14:54:50,228 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1678805683037.46b57114435577599b693b836e0ad8d2. 2023-03-14 14:54:50,228 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1678805683037.541dfbe822716da662f3a573a64aa05f. 2023-03-14 14:54:50,228 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1678805683037.46b57114435577599b693b836e0ad8d2. started... 2023-03-14 14:54:50,228 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1678805683037.d03921af574c9e368e124258e08ab95d. started... 2023-03-14 14:54:50,228 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-14 14:54:50,228 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 46b57114435577599b693b836e0ad8d2 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-14 14:54:50,228 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d03921af574c9e368e124258e08ab95d 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-14 14:54:50,228 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:54:50,228 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1678805683037.541dfbe822716da662f3a573a64aa05f. started... 2023-03-14 14:54:50,228 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 541dfbe822716da662f3a573a64aa05f 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-14 14:54:50,647 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230314c26db956b7364b62b4786bde77df793b to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230314c26db956b7364b62b4786bde77df793b 2023-03-14 14:54:50,648 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230314166d9758f1064d329f3c4b65a7ba8729 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230314166d9758f1064d329f3c4b65a7ba8729 2023-03-14 14:54:50,649 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303149c8e68c75520486e8f847c138d0f55ce to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303149c8e68c75520486e8f847c138d0f55ce 2023-03-14 14:54:51,056 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/.tmp/family1/b3edf5484f304570ace5edaeaed6a1f1 2023-03-14 14:54:51,062 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/.tmp/family1/ef4e5b48bebf48c4a6d53a9834e30bb5 2023-03-14 14:54:51,062 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/.tmp/family1/3d7816c125124489b2759873bb2274f5 2023-03-14 14:54:51,078 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023031483e30a1951464765bcc5de07d8fb6026 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023031483e30a1951464765bcc5de07d8fb6026 2023-03-14 14:54:51,483 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/.tmp/family2/389ec0d426554927a09b80e5c5eafe3e 2023-03-14 14:54:51,486 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230314a2bf094ca161465eb35609449840a3eb to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230314a2bf094ca161465eb35609449840a3eb 2023-03-14 14:54:51,486 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230314215fbbd5c34a46138b7ef9d25f00f3ed to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230314215fbbd5c34a46138b7ef9d25f00f3ed 2023-03-14 14:54:51,489 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/.tmp/family1/b3edf5484f304570ace5edaeaed6a1f1 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1/b3edf5484f304570ace5edaeaed6a1f1 2023-03-14 14:54:51,494 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1/b3edf5484f304570ace5edaeaed6a1f1, entries=4, sequenceid=17, filesize=5.4 K 2023-03-14 14:54:51,494 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/.tmp/family2/389ec0d426554927a09b80e5c5eafe3e as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family2/389ec0d426554927a09b80e5c5eafe3e 2023-03-14 14:54:51,498 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family2/389ec0d426554927a09b80e5c5eafe3e, entries=2, sequenceid=17, filesize=5.1 K 2023-03-14 14:54:51,499 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 46b57114435577599b693b836e0ad8d2 in 1271ms, sequenceid=17, compaction requested=true 2023-03-14 14:54:51,499 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 46b57114435577599b693b836e0ad8d2: 2023-03-14 14:54:51,499 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1678805683037.46b57114435577599b693b836e0ad8d2. 2023-03-14 14:54:51,499 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-14 14:54:51,893 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/.tmp/family2/e417dad5ad4041b39481cc378b7bb1d7 2023-03-14 14:54:51,893 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/.tmp/family2/6c1df25b2a324da6a91f047c43539cd5 2023-03-14 14:54:51,901 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/.tmp/family1/3d7816c125124489b2759873bb2274f5 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1/3d7816c125124489b2759873bb2274f5 2023-03-14 14:54:51,902 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/.tmp/family1/ef4e5b48bebf48c4a6d53a9834e30bb5 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family1/ef4e5b48bebf48c4a6d53a9834e30bb5 2023-03-14 14:54:51,906 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1/3d7816c125124489b2759873bb2274f5, entries=4, sequenceid=17, filesize=5.4 K 2023-03-14 14:54:51,907 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family1/ef4e5b48bebf48c4a6d53a9834e30bb5, entries=4, sequenceid=17, filesize=5.4 K 2023-03-14 14:54:51,907 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/.tmp/family2/6c1df25b2a324da6a91f047c43539cd5 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family2/6c1df25b2a324da6a91f047c43539cd5 2023-03-14 14:54:51,908 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/.tmp/family2/e417dad5ad4041b39481cc378b7bb1d7 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family2/e417dad5ad4041b39481cc378b7bb1d7 2023-03-14 14:54:51,913 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family2/e417dad5ad4041b39481cc378b7bb1d7, entries=2, sequenceid=17, filesize=5.1 K 2023-03-14 14:54:51,913 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family2/6c1df25b2a324da6a91f047c43539cd5, entries=2, sequenceid=17, filesize=5.1 K 2023-03-14 14:54:51,914 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for d03921af574c9e368e124258e08ab95d in 1686ms, sequenceid=17, compaction requested=true 2023-03-14 14:54:51,914 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 541dfbe822716da662f3a573a64aa05f in 1686ms, sequenceid=17, compaction requested=true 2023-03-14 14:54:51,914 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d03921af574c9e368e124258e08ab95d: 2023-03-14 14:54:51,914 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 541dfbe822716da662f3a573a64aa05f: 2023-03-14 14:54:51,914 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1678805683037.541dfbe822716da662f3a573a64aa05f. 2023-03-14 14:54:51,914 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1678805683037.d03921af574c9e368e124258e08ab95d. 2023-03-14 14:54:51,914 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-14 14:54:51,914 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-14 14:54:51,914 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-14 14:54:51,914 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:51,914 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-03-14 14:54:51,914 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-03-14 14:54:51,915 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:51,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:51,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:51,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:51,916 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-14 14:54:51,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:51,916 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-14 14:54:51,916 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:54:51,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:51,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-14 14:54:51,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:51,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:51,917 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-03-14 14:54:51,917 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5ffbc277[Count = 0] remaining members to acquire global barrier 2023-03-14 14:54:51,917 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-03-14 14:54:51,917 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-14 14:54:51,918 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-14 14:54:51,918 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-14 14:54:51,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-14 14:54:51,918 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-03-14 14:54:51,918 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:51,918 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:54:51,918 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-03-14 14:54:51,918 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:54:51,919 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:51,919 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-03-14 14:54:51,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:51,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:51,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:51,919 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:54:51,919 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-03-14 14:54:51,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:51,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:51,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-14 14:54:51,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:51,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:51,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-14 14:54:51,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:51,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:54:51,921 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-03-14 14:54:51,921 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-03-14 14:54:51,921 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:54:51,921 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:54:51,921 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-03-14 14:54:51,921 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:54:51,922 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 14:54:51,922 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 14:54:51,922 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 14:54:51,922 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:54:51,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 14:54:51,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 14:54:51,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:51,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:51,922 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:54:51,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:54:51,922 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:51,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:51,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 14:54:51,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-14 14:54:51,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:51,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-14 14:54:51,923 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:51,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:51,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:51,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-14 14:54:51,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:51,925 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:54:51,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:54:51,925 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:54:51,925 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-03-14 14:54:51,925 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-03-14 14:54:51,925 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:54:51,925 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:54:51,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:54:51,925 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-03-14 14:54:51,925 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:54:51,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:54:51,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:54:51,930 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:51,930 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-14 14:54:51,930 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-14 14:54:51,930 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:51,930 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-14 14:54:51,930 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-14 14:54:51,930 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 14:54:52,026 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:54:52,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:54:52,041 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1580): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb-1678805692027 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-14 14:54:52,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1678805692041 (current time:1678805692041). 2023-03-14 14:54:52,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-03-14 14:54:52,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] zookeeper.ReadOnlyZKClient(139): Connect 0x10d93dbf to 127.0.0.1:50211 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-14 14:54:52,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@42fda15c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-14 14:54:52,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-14 14:54:52,054 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:37912, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-14 14:54:52,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x10d93dbf to 127.0.0.1:50211 2023-03-14 14:54:52,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-14 14:54:52,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-03-14 14:54:52,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb-1678805692027 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-14 14:54:52,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure2.ProcedureExecutor(1029): Stored pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-03-14 14:54:52,066 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-03-14 14:54:52,066 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=86, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1678806292066 2023-03-14 14:54:52,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb-1678805692027 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-14 14:54:52,067 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb-1678805692027 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-03-14 14:54:52,068 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=86, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-03-14 14:54:52,068 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-03-14 14:54:52,068 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=86, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 4 msec 2023-03-14 14:54:52,069 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-03-14 14:54:52,069 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=87, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED; timeout=600000, timestamp=1678806292069 2023-03-14 14:54:52,072 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb-1678805692027 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-03-14 14:54:52,072 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-03-14 14:54:52,172 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-14 14:54:52,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1678805692027 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-14 14:54:52,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1678805692027 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-14 14:54:52,178 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-03-14 14:54:52,378 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-14 14:54:52,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1678805692027 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-14 14:54:52,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1678805692027 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-14 14:54:52,382 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-03-14 14:54:52,480 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb-1678805692027 2023-03-14 14:54:52,481 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb-1678805692027' 2023-03-14 14:54:52,481 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-03-14 14:54:52,481 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb-1678805692027' starting 'acquire' 2023-03-14 14:54:52,481 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb-1678805692027', kicking off acquire phase on members. 2023-03-14 14:54:52,483 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1678805692027 2023-03-14 14:54:52,483 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb-1678805692027 2023-03-14 14:54:52,485 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-03-14 14:54:52,485 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb-1678805692027/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:52,485 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-03-14 14:54:52,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-03-14 14:54:52,486 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb-1678805692027/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:52,486 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:54:52,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb-1678805692027 2023-03-14 14:54:52,487 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1678805692027 2023-03-14 14:54:52,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-03-14 14:54:52,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb-1678805692027 2023-03-14 14:54:52,487 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb-1678805692027 from table testCompactionWithHFileLink type FLUSH 2023-03-14 14:54:52,489 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb-1678805692027 2023-03-14 14:54:52,489 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb-1678805692027' with timeout 300000ms 2023-03-14 14:54:52,489 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-03-14 14:54:52,489 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb-1678805692027' starting 'acquire' stage 2023-03-14 14:54:52,489 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb-1678805692027' locally acquired 2023-03-14 14:54:52,489 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (snaptb-1678805692027) in zk 2023-03-14 14:54:52,498 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1678805692027/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:52,498 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb-1678805692027 2023-03-14 14:54:52,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb-1678805692027/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:52,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:52,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-03-14 14:54:52,499 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1678805692027 2023-03-14 14:54:52,499 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb-1678805692027' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:54:52,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:52,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:52,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1678805692027 2023-03-14 14:54:52,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:52,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:52,500 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'snaptb-1678805692027' on coordinator 2023-03-14 14:54:52,500 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@78ec2fe3[Count = 0] remaining members to acquire global barrier 2023-03-14 14:54:52,500 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb-1678805692027' starting 'in-barrier' execution. 2023-03-14 14:54:52,500 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb-1678805692027 2023-03-14 14:54:52,502 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1678805692027 2023-03-14 14:54:52,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb-1678805692027 2023-03-14 14:54:52,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb-1678805692027 2023-03-14 14:54:52,503 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb-1678805692027' received 'reached' from coordinator. 2023-03-14 14:54:52,503 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1678805692027/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:52,503 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:54:52,504 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,2,1678805683037.d03921af574c9e368e124258e08ab95d. 2023-03-14 14:54:52,504 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,1,1678805683037.46b57114435577599b693b836e0ad8d2. 2023-03-14 14:54:52,504 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 3 regions 2023-03-14 14:54:52,504 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,,1678805683037.541dfbe822716da662f3a573a64aa05f. 2023-03-14 14:54:52,504 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-03-14 14:54:52,504 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,2,1678805683037.d03921af574c9e368e124258e08ab95d. started... 2023-03-14 14:54:52,504 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,,1678805683037.541dfbe822716da662f3a573a64aa05f. started... 2023-03-14 14:54:52,504 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,1,1678805683037.46b57114435577599b693b836e0ad8d2. started... 2023-03-14 14:54:52,504 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-snapshot-pool-2] regionserver.HRegion(2446): Flush status journal for 541dfbe822716da662f3a573a64aa05f: 2023-03-14 14:54:52,504 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d03921af574c9e368e124258e08ab95d: 2023-03-14 14:54:52,504 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-snapshot-pool-1] regionserver.HRegion(2446): Flush status journal for 46b57114435577599b693b836e0ad8d2: 2023-03-14 14:54:52,505 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,,1678805683037.541dfbe822716da662f3a573a64aa05f.' region-info for snapshot=snaptb-1678805692027 2023-03-14 14:54:52,505 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,2,1678805683037.d03921af574c9e368e124258e08ab95d.' region-info for snapshot=snaptb-1678805692027 2023-03-14 14:54:52,505 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,1,1678805683037.46b57114435577599b693b836e0ad8d2.' region-info for snapshot=snaptb-1678805692027 2023-03-14 14:54:52,511 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-03-14 14:54:52,511 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-03-14 14:54:52,511 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-03-14 14:54:52,515 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family1/7bedf33c34414f65b99ef964dca782ad, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family1/25a93ba0de464a7680c159909c51660b, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family1/0d78103959d84c55bf5fd402a71523ff, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family1/ef4e5b48bebf48c4a6d53a9834e30bb5] hfiles 2023-03-14 14:54:52,515 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1/c9bf5b936237414485b321f354149a3f, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1/a6062f3df98748bdabc1471e8d8f1031, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1/b19c3c6a9bf5422989ad34b1bd3dd634, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1/b3edf5484f304570ace5edaeaed6a1f1] hfiles 2023-03-14 14:54:52,515 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1/c9bf5b936237414485b321f354149a3f for snapshot=snaptb-1678805692027 2023-03-14 14:54:52,515 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1/70e0f28062314487bee0b6ed2ce10d0b, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1/591c70d95e90448b9e60702762d6fe7b, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1/1b5ac87360aa4bb191cc4449750a7907, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1/3d7816c125124489b2759873bb2274f5] hfiles 2023-03-14 14:54:52,515 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1/70e0f28062314487bee0b6ed2ce10d0b for snapshot=snaptb-1678805692027 2023-03-14 14:54:52,515 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family1/7bedf33c34414f65b99ef964dca782ad for snapshot=snaptb-1678805692027 2023-03-14 14:54:52,519 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1/a6062f3df98748bdabc1471e8d8f1031 for snapshot=snaptb-1678805692027 2023-03-14 14:54:52,519 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1/b19c3c6a9bf5422989ad34b1bd3dd634 for snapshot=snaptb-1678805692027 2023-03-14 14:54:52,519 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1/b3edf5484f304570ace5edaeaed6a1f1 for snapshot=snaptb-1678805692027 2023-03-14 14:54:52,519 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1/591c70d95e90448b9e60702762d6fe7b for snapshot=snaptb-1678805692027 2023-03-14 14:54:52,519 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family2/f50ca180804e42159fa65ddb96403962, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family2/b01622885e094dce84b6378c5e6e9a6f, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family2/1628452bcbc044978e89d0017623b719, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family2/389ec0d426554927a09b80e5c5eafe3e] hfiles 2023-03-14 14:54:52,519 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family2/f50ca180804e42159fa65ddb96403962 for snapshot=snaptb-1678805692027 2023-03-14 14:54:52,519 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family1/25a93ba0de464a7680c159909c51660b for snapshot=snaptb-1678805692027 2023-03-14 14:54:52,519 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family1/0d78103959d84c55bf5fd402a71523ff for snapshot=snaptb-1678805692027 2023-03-14 14:54:52,519 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family1/ef4e5b48bebf48c4a6d53a9834e30bb5 for snapshot=snaptb-1678805692027 2023-03-14 14:54:52,519 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family2/b01622885e094dce84b6378c5e6e9a6f for snapshot=snaptb-1678805692027 2023-03-14 14:54:52,519 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family2/1628452bcbc044978e89d0017623b719 for snapshot=snaptb-1678805692027 2023-03-14 14:54:52,519 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family2/389ec0d426554927a09b80e5c5eafe3e for snapshot=snaptb-1678805692027 2023-03-14 14:54:52,519 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1/1b5ac87360aa4bb191cc4449750a7907 for snapshot=snaptb-1678805692027 2023-03-14 14:54:52,519 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1/3d7816c125124489b2759873bb2274f5 for snapshot=snaptb-1678805692027 2023-03-14 14:54:52,519 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family2/a8d3d3d688f44d5c98b54f77a810edfb, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family2/a25e279e24aa4b70919faaa31a07769a, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family2/9a13180cb0db4dbd970bf225dcab0e4c, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family2/e417dad5ad4041b39481cc378b7bb1d7] hfiles 2023-03-14 14:54:52,519 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family2/a8d3d3d688f44d5c98b54f77a810edfb for snapshot=snaptb-1678805692027 2023-03-14 14:54:52,519 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family2/a25e279e24aa4b70919faaa31a07769a for snapshot=snaptb-1678805692027 2023-03-14 14:54:52,519 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family2/9a13180cb0db4dbd970bf225dcab0e4c for snapshot=snaptb-1678805692027 2023-03-14 14:54:52,519 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family2/e417dad5ad4041b39481cc378b7bb1d7 for snapshot=snaptb-1678805692027 2023-03-14 14:54:52,519 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family2/3a131025d2344260a03875522668b04a, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family2/04bf20de187e447d8cd4c89e4ba37610, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family2/55badc960cc24ee5ad7320c72ae33a8f, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family2/6c1df25b2a324da6a91f047c43539cd5] hfiles 2023-03-14 14:54:52,520 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family2/3a131025d2344260a03875522668b04a for snapshot=snaptb-1678805692027 2023-03-14 14:54:52,520 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family2/04bf20de187e447d8cd4c89e4ba37610 for snapshot=snaptb-1678805692027 2023-03-14 14:54:52,520 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family2/55badc960cc24ee5ad7320c72ae33a8f for snapshot=snaptb-1678805692027 2023-03-14 14:54:52,520 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family2/6c1df25b2a324da6a91f047c43539cd5 for snapshot=snaptb-1678805692027 2023-03-14 14:54:52,682 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-14 14:54:52,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1678805692027 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-14 14:54:52,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1678805692027 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-14 14:54:52,683 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-03-14 14:54:52,934 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,2,1678805683037.d03921af574c9e368e124258e08ab95d. completed. 2023-03-14 14:54:52,934 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,2,1678805683037.d03921af574c9e368e124258e08ab95d. 2023-03-14 14:54:52,934 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,,1678805683037.541dfbe822716da662f3a573a64aa05f. completed. 2023-03-14 14:54:52,934 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,,1678805683037.541dfbe822716da662f3a573a64aa05f. 2023-03-14 14:54:52,934 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,1,1678805683037.46b57114435577599b693b836e0ad8d2. completed. 2023-03-14 14:54:52,935 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,1,1678805683037.46b57114435577599b693b836e0ad8d2. 2023-03-14 14:54:52,935 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/3 local region snapshots. 2023-03-14 14:54:52,935 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/3 local region snapshots. 2023-03-14 14:54:52,935 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/3 local region snapshots. 2023-03-14 14:54:52,935 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 3 local region snapshots. 2023-03-14 14:54:52,935 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:52,935 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb-1678805692027' locally completed 2023-03-14 14:54:52,935 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb-1678805692027' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:54:52,936 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1678805692027/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:52,936 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb-1678805692027' has notified controller of completion 2023-03-14 14:54:52,936 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:54:52,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb-1678805692027/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:52,936 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb-1678805692027' completed. 2023-03-14 14:54:52,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:52,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-03-14 14:54:52,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:52,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:52,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1678805692027 2023-03-14 14:54:52,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:52,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:52,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1678805692027 2023-03-14 14:54:52,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:52,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb-1678805692027' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:54:52,939 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'snaptb-1678805692027', counting down latch. Waiting for 0 more 2023-03-14 14:54:52,939 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb-1678805692027' execution completed 2023-03-14 14:54:52,939 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:54:52,939 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:54:52,939 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb-1678805692027 2023-03-14 14:54:52,939 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb-1678805692027including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-03-14 14:54:52,940 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1678805692027 2023-03-14 14:54:52,940 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1678805692027 2023-03-14 14:54:52,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb-1678805692027 2023-03-14 14:54:52,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:52,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-03-14 14:54:52,940 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb-1678805692027 2023-03-14 14:54:52,940 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-03-14 14:54:52,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1678805692027 2023-03-14 14:54:52,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:52,940 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-03-14 14:54:52,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-03-14 14:54:52,940 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb-1678805692027/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:52,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1678805692027 2023-03-14 14:54:52,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1678805692027 2023-03-14 14:54:52,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:52,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1678805692027 2023-03-14 14:54:52,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:52,941 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb-1678805692027/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:52,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:52,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1678805692027 2023-03-14 14:54:52,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:52,942 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1678805692027/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:52,942 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-03-14 14:54:52,942 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1678805692027 2023-03-14 14:54:52,942 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:54:52,942 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-03-14 14:54:52,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-03-14 14:54:52,942 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-03-14 14:54:52,942 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb-1678805692027 2023-03-14 14:54:52,942 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1678805692027 2023-03-14 14:54:52,942 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1678805692027/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:52,942 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1678805692027 2023-03-14 14:54:52,943 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testCompactionWithHFileLink 2023-03-14 14:54:52,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-03-14 14:54:52,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-03-14 14:54:52,943 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1678805692027 2023-03-14 14:54:52,943 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 0e7b6fa9e81bd62588edd7d77d6165e4, NAME => 'testCompactionWithHFileLink,.mob,0.0e7b6fa9e81bd62588edd7d77d6165e4.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb-1678805692027 2023-03-14 14:54:52,943 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1678805692027 2023-03-14 14:54:52,943 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-03-14 14:54:52,944 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303140793053a07d1492b94e2f50baefaf1e0, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303144f70f82c217d488083d264a4438a183c, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230314a5917ff88234474e908ccfc6684a0e94, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230314c26db956b7364b62b4786bde77df793b, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230314166d9758f1064d329f3c4b65a7ba8729, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303145ee28b82bdc245389b68cc7d9e252743, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230314976e5048cf584ab8bdad3c00af0cd325, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230314b353e02f869a49458bca945e03232f09, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023031409ce4a6ddfb84b438695750db282e007, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023031454adfebd63414c198bff0e938bfc1e87, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303149c8e68c75520486e8f847c138d0f55ce, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230314d71ba2d46f4e4de689ca125a16b89c45] mob files 2023-03-14 14:54:52,944 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303140793053a07d1492b94e2f50baefaf1e0 2023-03-14 14:54:52,944 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303144f70f82c217d488083d264a4438a183c 2023-03-14 14:54:52,944 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230314a5917ff88234474e908ccfc6684a0e94 2023-03-14 14:54:52,944 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230314c26db956b7364b62b4786bde77df793b 2023-03-14 14:54:52,944 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230314166d9758f1064d329f3c4b65a7ba8729 2023-03-14 14:54:52,944 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303145ee28b82bdc245389b68cc7d9e252743 2023-03-14 14:54:52,944 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230314976e5048cf584ab8bdad3c00af0cd325 2023-03-14 14:54:52,944 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230314b353e02f869a49458bca945e03232f09 2023-03-14 14:54:52,944 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023031409ce4a6ddfb84b438695750db282e007 2023-03-14 14:54:52,944 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023031454adfebd63414c198bff0e938bfc1e87 2023-03-14 14:54:52,944 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303149c8e68c75520486e8f847c138d0f55ce 2023-03-14 14:54:52,944 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230314d71ba2d46f4e4de689ca125a16b89c45 2023-03-14 14:54:52,945 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303145a943fa5bcc34dcbb791de97f3d197d7, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303147f4ba9a482cf4d1da182ae7bd70c57a6, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023031483e30a1951464765bcc5de07d8fb6026, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230314f33f5277e1e343218385288838cf2e73, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230314265d06ea88ef49fa8b4abd0ab50b8535, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202303144bff8261664046c187eb07e2237022fe, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230314a2bf094ca161465eb35609449840a3eb, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230314ec67fccb67af477e9088878826566c06, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230314215fbbd5c34a46138b7ef9d25f00f3ed, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230314270c91d86df24c9cafb1962842b0a97f, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202303145b6cbf9af4e542ad9fb96522f2d38b9d, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230314d6712bf865914adf9b8f5b3b39a2c79e] mob files 2023-03-14 14:54:52,945 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303145a943fa5bcc34dcbb791de97f3d197d7 2023-03-14 14:54:52,945 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303147f4ba9a482cf4d1da182ae7bd70c57a6 2023-03-14 14:54:52,945 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023031483e30a1951464765bcc5de07d8fb6026 2023-03-14 14:54:52,945 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230314f33f5277e1e343218385288838cf2e73 2023-03-14 14:54:52,945 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230314265d06ea88ef49fa8b4abd0ab50b8535 2023-03-14 14:54:52,945 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202303144bff8261664046c187eb07e2237022fe 2023-03-14 14:54:52,945 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230314a2bf094ca161465eb35609449840a3eb 2023-03-14 14:54:52,945 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230314ec67fccb67af477e9088878826566c06 2023-03-14 14:54:52,945 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230314215fbbd5c34a46138b7ef9d25f00f3ed 2023-03-14 14:54:52,945 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230314270c91d86df24c9cafb1962842b0a97f 2023-03-14 14:54:52,945 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202303145b6cbf9af4e542ad9fb96522f2d38b9d 2023-03-14 14:54:52,945 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230314d6712bf865914adf9b8f5b3b39a2c79e 2023-03-14 14:54:52,951 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb-1678805692027 2023-03-14 14:54:52,954 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.hbase-snapshot/.tmp/snaptb-1678805692027 2023-03-14 14:54:53,231 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-14 14:54:53,232 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(142): Chore: CompactedHFilesCleaner missed its start time 2023-03-14 14:54:53,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1678805692027 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-14 14:54:53,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1678805692027 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-14 14:54:53,233 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-03-14 14:54:53,234 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-14 14:54:53,234 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x64ecc1bc to 127.0.0.1:50211 2023-03-14 14:54:53,234 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-14 14:54:53,272 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.hbase-snapshot/.tmp/snaptb-1678805692027 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.hbase-snapshot/snaptb-1678805692027 2023-03-14 14:54:53,338 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb-1678805692027 of table testCompactionWithHFileLink completed 2023-03-14 14:54:53,339 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.hbase-snapshot/.tmp/snaptb-1678805692027 2023-03-14 14:54:53,339 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.hbase-snapshot/.tmp/snaptb-1678805692027 2023-03-14 14:54:53,339 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb-1678805692027 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1678805692067Completed referencing HFiles for the mob region of table: testCompactionWithHFileLink at 1678805692951 (+884 ms)Consolidate snapshot: snaptb-1678805692027 at 1678805692951Loading Region manifests for snaptb-1678805692027 at 1678805692951Writing data manifest for snaptb-1678805692027 at 1678805692969 (+18 ms)Verifying snapshot: snaptb-1678805692027 at 1678805693016 (+47 ms)Snapshot snaptb-1678805692027 of table testCompactionWithHFileLink completed at 1678805693338 (+322 ms) 2023-03-14 14:54:53,340 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=87, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-03-14 14:54:53,342 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=87, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED in 1.2720 sec 2023-03-14 14:54:54,233 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-14 14:54:54,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1678805692027 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-14 14:54:54,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb-1678805692027 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-03-14 14:54:54,266 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:54:54,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-03-14 14:54:54,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-03-14 14:54:54,268 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-03-14 14:54:54,268 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:54:54,268 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-03-14 14:54:54,268 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-03-14 14:54:54,269 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 14:54:54,269 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-14 14:54:54,269 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:54:54,269 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:54,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:54:54,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:54:54,270 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:54,270 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:54:54,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-14 14:54:54,270 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 14:54:54,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:54:54,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-14 14:54:54,270 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-03-14 14:54:54,271 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-03-14 14:54:54,271 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-03-14 14:54:54,271 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:54:54,271 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-03-14 14:54:54,271 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1678805683037.d03921af574c9e368e124258e08ab95d. 2023-03-14 14:54:54,271 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1678805683037.d03921af574c9e368e124258e08ab95d. started... 2023-03-14 14:54:54,271 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1678805683037.46b57114435577599b693b836e0ad8d2. 2023-03-14 14:54:54,271 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1678805683037.46b57114435577599b693b836e0ad8d2. started... 2023-03-14 14:54:54,271 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d03921af574c9e368e124258e08ab95d 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-14 14:54:54,271 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 46b57114435577599b693b836e0ad8d2 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-14 14:54:54,271 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-14 14:54:54,271 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:54:54,271 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1678805683037.541dfbe822716da662f3a573a64aa05f. 2023-03-14 14:54:54,272 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1678805683037.541dfbe822716da662f3a573a64aa05f. started... 2023-03-14 14:54:54,272 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 541dfbe822716da662f3a573a64aa05f 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-14 14:54:55,093 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/.tmp/family1/7c9efba9fed3418d8447194a644acc60 2023-03-14 14:54:55,093 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/.tmp/family1/b881c569dc0b411ba7f1b49938786aed 2023-03-14 14:54:55,093 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/.tmp/family1/fb30151e338a4d5da08e95b962160290 2023-03-14 14:54:55,102 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7c9efba9fed3418d8447194a644acc60 2023-03-14 14:54:55,102 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b881c569dc0b411ba7f1b49938786aed 2023-03-14 14:54:55,102 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fb30151e338a4d5da08e95b962160290 2023-03-14 14:54:55,343 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-14 14:54:55,937 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/.tmp/family2/65278030232d45d2a277492949f0b63b 2023-03-14 14:54:55,937 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/.tmp/family2/2d172296ef8b4d8dbfd4cee0d7d4608d 2023-03-14 14:54:55,937 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/.tmp/family2/5de0aef5602b4599b182b30f87fa2f4e 2023-03-14 14:54:55,945 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2d172296ef8b4d8dbfd4cee0d7d4608d 2023-03-14 14:54:55,945 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5de0aef5602b4599b182b30f87fa2f4e 2023-03-14 14:54:55,945 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 65278030232d45d2a277492949f0b63b 2023-03-14 14:54:55,946 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/.tmp/family1/fb30151e338a4d5da08e95b962160290 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1/fb30151e338a4d5da08e95b962160290 2023-03-14 14:54:55,946 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/.tmp/family1/7c9efba9fed3418d8447194a644acc60 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family1/7c9efba9fed3418d8447194a644acc60 2023-03-14 14:54:55,946 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/.tmp/family1/b881c569dc0b411ba7f1b49938786aed as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1/b881c569dc0b411ba7f1b49938786aed 2023-03-14 14:54:55,950 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7c9efba9fed3418d8447194a644acc60 2023-03-14 14:54:55,950 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b881c569dc0b411ba7f1b49938786aed 2023-03-14 14:54:55,950 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family1/7c9efba9fed3418d8447194a644acc60, entries=3, sequenceid=24, filesize=5.0 K 2023-03-14 14:54:55,950 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1/b881c569dc0b411ba7f1b49938786aed, entries=3, sequenceid=24, filesize=5.0 K 2023-03-14 14:54:55,950 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fb30151e338a4d5da08e95b962160290 2023-03-14 14:54:55,950 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1/fb30151e338a4d5da08e95b962160290, entries=3, sequenceid=24, filesize=5.0 K 2023-03-14 14:54:55,951 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/.tmp/family2/5de0aef5602b4599b182b30f87fa2f4e as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family2/5de0aef5602b4599b182b30f87fa2f4e 2023-03-14 14:54:55,951 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/.tmp/family2/65278030232d45d2a277492949f0b63b as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family2/65278030232d45d2a277492949f0b63b 2023-03-14 14:54:55,951 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/.tmp/family2/2d172296ef8b4d8dbfd4cee0d7d4608d as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family2/2d172296ef8b4d8dbfd4cee0d7d4608d 2023-03-14 14:54:55,954 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5de0aef5602b4599b182b30f87fa2f4e 2023-03-14 14:54:55,954 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2d172296ef8b4d8dbfd4cee0d7d4608d 2023-03-14 14:54:55,954 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family2/5de0aef5602b4599b182b30f87fa2f4e, entries=1, sequenceid=24, filesize=5.0 K 2023-03-14 14:54:55,954 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family2/2d172296ef8b4d8dbfd4cee0d7d4608d, entries=1, sequenceid=24, filesize=5.0 K 2023-03-14 14:54:55,954 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 65278030232d45d2a277492949f0b63b 2023-03-14 14:54:55,955 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family2/65278030232d45d2a277492949f0b63b, entries=1, sequenceid=24, filesize=5.0 K 2023-03-14 14:54:55,955 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 46b57114435577599b693b836e0ad8d2 in 1684ms, sequenceid=24, compaction requested=true 2023-03-14 14:54:55,955 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for d03921af574c9e368e124258e08ab95d in 1684ms, sequenceid=24, compaction requested=true 2023-03-14 14:54:55,955 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 541dfbe822716da662f3a573a64aa05f in 1683ms, sequenceid=24, compaction requested=true 2023-03-14 14:54:55,955 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d03921af574c9e368e124258e08ab95d: 2023-03-14 14:54:55,955 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 46b57114435577599b693b836e0ad8d2: 2023-03-14 14:54:55,955 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1678805683037.d03921af574c9e368e124258e08ab95d. 2023-03-14 14:54:55,955 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 541dfbe822716da662f3a573a64aa05f: 2023-03-14 14:54:55,955 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-14 14:54:55,955 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1678805683037.46b57114435577599b693b836e0ad8d2. 2023-03-14 14:54:55,955 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1678805683037.541dfbe822716da662f3a573a64aa05f. 2023-03-14 14:54:55,955 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-14 14:54:55,956 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-14 14:54:55,956 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-14 14:54:55,956 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:55,956 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-03-14 14:54:55,956 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-03-14 14:54:55,957 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:55,957 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-14 14:54:55,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:55,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:55,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:55,957 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-14 14:54:55,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:55,957 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:54:55,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:55,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-14 14:54:55,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:55,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:55,958 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-03-14 14:54:55,958 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7d45feae[Count = 0] remaining members to acquire global barrier 2023-03-14 14:54:55,958 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-03-14 14:54:55,958 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-14 14:54:55,959 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-14 14:54:55,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-14 14:54:55,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-14 14:54:55,959 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-03-14 14:54:55,959 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-03-14 14:54:55,959 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:54:55,959 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:55,959 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:54:55,960 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:55,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:55,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:55,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:55,960 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-03-14 14:54:55,960 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:54:55,960 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-03-14 14:54:55,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:55,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:55,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-14 14:54:55,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:55,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:55,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-14 14:54:55,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:55,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:54:55,962 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-03-14 14:54:55,962 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-03-14 14:54:55,962 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:54:55,962 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:54:55,962 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-03-14 14:54:55,962 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:54:55,963 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 14:54:55,963 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 14:54:55,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 14:54:55,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:54:55,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:54:55,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 14:54:55,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 14:54:55,963 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:54:55,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:54:55,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:54:55,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:54:55,963 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:55,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-14 14:54:55,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 14:54:55,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:54:55,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-14 14:54:55,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:55,964 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:55,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:54:55,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-03-14 14:54:55,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:55,965 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:55,965 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-14 14:54:55,965 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:54:55,965 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-03-14 14:54:55,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:54:55,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:54:55,965 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:54:55,965 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-03-14 14:54:55,965 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:54:55,965 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:54:55,965 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:54:55,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:54:55,965 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-14 14:54:55,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:54:55,965 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-03-14 14:54:55,966 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-03-14 14:54:55,966 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-03-14 14:54:55,966 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:54:56,066 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:54:56,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:54:56,069 DEBUG [Listener at localhost.localdomain/44261] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-14 14:54:56,069 DEBUG [Listener at localhost.localdomain/44261] regionserver.HStore(1912): d03921af574c9e368e124258e08ab95d/family1 is initiating major compaction (all files) 2023-03-14 14:54:56,069 INFO [Listener at localhost.localdomain/44261] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-14 14:54:56,069 INFO [Listener at localhost.localdomain/44261] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-14 14:54:56,070 INFO [Listener at localhost.localdomain/44261] regionserver.HRegion(2259): Starting compaction of d03921af574c9e368e124258e08ab95d/family1 in testCompactionWithHFileLink,2,1678805683037.d03921af574c9e368e124258e08ab95d. 2023-03-14 14:54:56,070 INFO [Listener at localhost.localdomain/44261] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family1/7bedf33c34414f65b99ef964dca782ad, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family1/25a93ba0de464a7680c159909c51660b, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family1/0d78103959d84c55bf5fd402a71523ff, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family1/ef4e5b48bebf48c4a6d53a9834e30bb5, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family1/7c9efba9fed3418d8447194a644acc60] into tmpdir=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/.tmp, totalSize=26.7 K 2023-03-14 14:54:56,071 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting 7bedf33c34414f65b99ef964dca782ad, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678805685169 2023-03-14 14:54:56,072 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting 25a93ba0de464a7680c159909c51660b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678805686982 2023-03-14 14:54:56,074 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting 0d78103959d84c55bf5fd402a71523ff, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678805688805 2023-03-14 14:54:56,075 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting ef4e5b48bebf48c4a6d53a9834e30bb5, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678805690218 2023-03-14 14:54:56,076 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting 7c9efba9fed3418d8447194a644acc60, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-03-14 14:54:56,098 INFO [Listener at localhost.localdomain/44261] throttle.PressureAwareThroughputController(145): d03921af574c9e368e124258e08ab95d#family1#compaction#108 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-14 14:54:56,513 INFO [Listener at localhost.localdomain/44261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230314664298466abd4b7d837b450694ceae9a_del 2023-03-14 14:54:56,513 INFO [Listener at localhost.localdomain/44261] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230314664298466abd4b7d837b450694ceae9a_del to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230314664298466abd4b7d837b450694ceae9a_del 2023-03-14 14:54:57,343 INFO [Listener at localhost.localdomain/44261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 014615fb0fa34bb4a0687a5e9ccd717c 2023-03-14 14:54:57,345 DEBUG [Listener at localhost.localdomain/44261] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/.tmp/family1/014615fb0fa34bb4a0687a5e9ccd717c as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family1/014615fb0fa34bb4a0687a5e9ccd717c 2023-03-14 14:54:57,352 INFO [Listener at localhost.localdomain/44261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 014615fb0fa34bb4a0687a5e9ccd717c 2023-03-14 14:54:57,353 INFO [Listener at localhost.localdomain/44261] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in d03921af574c9e368e124258e08ab95d/family1 of d03921af574c9e368e124258e08ab95d into 014615fb0fa34bb4a0687a5e9ccd717c(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-14 14:54:57,353 DEBUG [Listener at localhost.localdomain/44261] regionserver.HRegion(2289): Compaction status journal for d03921af574c9e368e124258e08ab95d: 2023-03-14 14:54:57,354 DEBUG [Listener at localhost.localdomain/44261] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-14 14:54:57,354 DEBUG [Listener at localhost.localdomain/44261] regionserver.HStore(1912): d03921af574c9e368e124258e08ab95d/family2 is initiating major compaction (all files) 2023-03-14 14:54:57,354 INFO [Listener at localhost.localdomain/44261] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-14 14:54:57,354 INFO [Listener at localhost.localdomain/44261] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-14 14:54:57,354 INFO [Listener at localhost.localdomain/44261] regionserver.HRegion(2259): Starting compaction of d03921af574c9e368e124258e08ab95d/family2 in testCompactionWithHFileLink,2,1678805683037.d03921af574c9e368e124258e08ab95d. 2023-03-14 14:54:57,354 INFO [Listener at localhost.localdomain/44261] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family2/a8d3d3d688f44d5c98b54f77a810edfb, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family2/a25e279e24aa4b70919faaa31a07769a, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family2/9a13180cb0db4dbd970bf225dcab0e4c, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family2/e417dad5ad4041b39481cc378b7bb1d7, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family2/5de0aef5602b4599b182b30f87fa2f4e] into tmpdir=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/.tmp, totalSize=25.4 K 2023-03-14 14:54:57,355 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting a8d3d3d688f44d5c98b54f77a810edfb, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678805685169 2023-03-14 14:54:57,355 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting a25e279e24aa4b70919faaa31a07769a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678805686982 2023-03-14 14:54:57,356 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting 9a13180cb0db4dbd970bf225dcab0e4c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678805688805 2023-03-14 14:54:57,356 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting e417dad5ad4041b39481cc378b7bb1d7, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678805690218 2023-03-14 14:54:57,357 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting 5de0aef5602b4599b182b30f87fa2f4e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-03-14 14:54:57,371 INFO [Listener at localhost.localdomain/44261] throttle.PressureAwareThroughputController(145): d03921af574c9e368e124258e08ab95d#family2#compaction#109 average throughput is 0.35 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-14 14:54:57,433 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family1/7bedf33c34414f65b99ef964dca782ad, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family1/25a93ba0de464a7680c159909c51660b, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family1/0d78103959d84c55bf5fd402a71523ff, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family1/ef4e5b48bebf48c4a6d53a9834e30bb5, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family1/7c9efba9fed3418d8447194a644acc60] to archive 2023-03-14 14:54:57,434 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 14:54:57,436 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family1/7bedf33c34414f65b99ef964dca782ad to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family1/7bedf33c34414f65b99ef964dca782ad 2023-03-14 14:54:57,439 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family1/25a93ba0de464a7680c159909c51660b to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family1/25a93ba0de464a7680c159909c51660b 2023-03-14 14:54:57,441 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family1/0d78103959d84c55bf5fd402a71523ff to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family1/0d78103959d84c55bf5fd402a71523ff 2023-03-14 14:54:57,443 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family1/ef4e5b48bebf48c4a6d53a9834e30bb5 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family1/ef4e5b48bebf48c4a6d53a9834e30bb5 2023-03-14 14:54:57,444 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family1/7c9efba9fed3418d8447194a644acc60 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family1/7c9efba9fed3418d8447194a644acc60 2023-03-14 14:54:57,789 INFO [Listener at localhost.localdomain/44261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230314b7bd66a1d9b845239012f68a9805ebbf_del 2023-03-14 14:54:57,789 INFO [Listener at localhost.localdomain/44261] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230314b7bd66a1d9b845239012f68a9805ebbf_del to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230314b7bd66a1d9b845239012f68a9805ebbf_del 2023-03-14 14:54:58,618 INFO [Listener at localhost.localdomain/44261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 50402a68999a42db8b5fd2da13f8cd53 2023-03-14 14:54:58,620 DEBUG [Listener at localhost.localdomain/44261] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/.tmp/family2/50402a68999a42db8b5fd2da13f8cd53 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family2/50402a68999a42db8b5fd2da13f8cd53 2023-03-14 14:54:58,625 INFO [Listener at localhost.localdomain/44261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 50402a68999a42db8b5fd2da13f8cd53 2023-03-14 14:54:58,626 INFO [Listener at localhost.localdomain/44261] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in d03921af574c9e368e124258e08ab95d/family2 of d03921af574c9e368e124258e08ab95d into 50402a68999a42db8b5fd2da13f8cd53(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-14 14:54:58,626 DEBUG [Listener at localhost.localdomain/44261] regionserver.HRegion(2289): Compaction status journal for d03921af574c9e368e124258e08ab95d: 2023-03-14 14:54:58,626 DEBUG [Listener at localhost.localdomain/44261] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-14 14:54:58,626 DEBUG [Listener at localhost.localdomain/44261] regionserver.HStore(1912): 46b57114435577599b693b836e0ad8d2/family1 is initiating major compaction (all files) 2023-03-14 14:54:58,626 INFO [Listener at localhost.localdomain/44261] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-14 14:54:58,626 INFO [Listener at localhost.localdomain/44261] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-14 14:54:58,626 INFO [Listener at localhost.localdomain/44261] regionserver.HRegion(2259): Starting compaction of 46b57114435577599b693b836e0ad8d2/family1 in testCompactionWithHFileLink,1,1678805683037.46b57114435577599b693b836e0ad8d2. 2023-03-14 14:54:58,627 INFO [Listener at localhost.localdomain/44261] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1/c9bf5b936237414485b321f354149a3f, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1/a6062f3df98748bdabc1471e8d8f1031, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1/b19c3c6a9bf5422989ad34b1bd3dd634, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1/b3edf5484f304570ace5edaeaed6a1f1, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1/fb30151e338a4d5da08e95b962160290] into tmpdir=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/.tmp, totalSize=26.7 K 2023-03-14 14:54:58,627 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting c9bf5b936237414485b321f354149a3f, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678805685168 2023-03-14 14:54:58,627 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting a6062f3df98748bdabc1471e8d8f1031, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678805686982 2023-03-14 14:54:58,628 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting b19c3c6a9bf5422989ad34b1bd3dd634, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678805688805 2023-03-14 14:54:58,628 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting b3edf5484f304570ace5edaeaed6a1f1, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678805690218 2023-03-14 14:54:58,629 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting fb30151e338a4d5da08e95b962160290, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-03-14 14:54:58,633 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family2/a8d3d3d688f44d5c98b54f77a810edfb, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family2/a25e279e24aa4b70919faaa31a07769a, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family2/9a13180cb0db4dbd970bf225dcab0e4c, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family2/e417dad5ad4041b39481cc378b7bb1d7, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family2/5de0aef5602b4599b182b30f87fa2f4e] to archive 2023-03-14 14:54:58,633 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 14:54:58,635 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family2/a8d3d3d688f44d5c98b54f77a810edfb to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family2/a8d3d3d688f44d5c98b54f77a810edfb 2023-03-14 14:54:58,636 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family2/a25e279e24aa4b70919faaa31a07769a to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family2/a25e279e24aa4b70919faaa31a07769a 2023-03-14 14:54:58,637 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family2/9a13180cb0db4dbd970bf225dcab0e4c to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family2/9a13180cb0db4dbd970bf225dcab0e4c 2023-03-14 14:54:58,637 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family2/e417dad5ad4041b39481cc378b7bb1d7 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family2/e417dad5ad4041b39481cc378b7bb1d7 2023-03-14 14:54:58,638 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family2/5de0aef5602b4599b182b30f87fa2f4e to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family2/5de0aef5602b4599b182b30f87fa2f4e 2023-03-14 14:54:58,639 INFO [Listener at localhost.localdomain/44261] throttle.PressureAwareThroughputController(145): 46b57114435577599b693b836e0ad8d2#family1#compaction#110 average throughput is 0.85 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-14 14:54:59,054 INFO [Listener at localhost.localdomain/44261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230314df68625bc2a74f6ca9e097fb1dfc74c1_del 2023-03-14 14:54:59,055 INFO [Listener at localhost.localdomain/44261] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230314df68625bc2a74f6ca9e097fb1dfc74c1_del to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230314df68625bc2a74f6ca9e097fb1dfc74c1_del 2023-03-14 14:54:59,882 INFO [Listener at localhost.localdomain/44261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 31ab69da4fb54927a409b390e3eff93c 2023-03-14 14:54:59,883 DEBUG [Listener at localhost.localdomain/44261] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/.tmp/family1/31ab69da4fb54927a409b390e3eff93c as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1/31ab69da4fb54927a409b390e3eff93c 2023-03-14 14:54:59,886 INFO [Listener at localhost.localdomain/44261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 31ab69da4fb54927a409b390e3eff93c 2023-03-14 14:54:59,887 INFO [Listener at localhost.localdomain/44261] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 46b57114435577599b693b836e0ad8d2/family1 of 46b57114435577599b693b836e0ad8d2 into 31ab69da4fb54927a409b390e3eff93c(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-14 14:54:59,887 DEBUG [Listener at localhost.localdomain/44261] regionserver.HRegion(2289): Compaction status journal for 46b57114435577599b693b836e0ad8d2: 2023-03-14 14:54:59,887 DEBUG [Listener at localhost.localdomain/44261] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-14 14:54:59,887 DEBUG [Listener at localhost.localdomain/44261] regionserver.HStore(1912): 46b57114435577599b693b836e0ad8d2/family2 is initiating major compaction (all files) 2023-03-14 14:54:59,887 INFO [Listener at localhost.localdomain/44261] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-14 14:54:59,887 INFO [Listener at localhost.localdomain/44261] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-14 14:54:59,888 INFO [Listener at localhost.localdomain/44261] regionserver.HRegion(2259): Starting compaction of 46b57114435577599b693b836e0ad8d2/family2 in testCompactionWithHFileLink,1,1678805683037.46b57114435577599b693b836e0ad8d2. 2023-03-14 14:54:59,888 INFO [Listener at localhost.localdomain/44261] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family2/f50ca180804e42159fa65ddb96403962, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family2/b01622885e094dce84b6378c5e6e9a6f, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family2/1628452bcbc044978e89d0017623b719, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family2/389ec0d426554927a09b80e5c5eafe3e, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family2/2d172296ef8b4d8dbfd4cee0d7d4608d] into tmpdir=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/.tmp, totalSize=25.4 K 2023-03-14 14:54:59,888 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting f50ca180804e42159fa65ddb96403962, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678805685168 2023-03-14 14:54:59,889 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting b01622885e094dce84b6378c5e6e9a6f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678805686982 2023-03-14 14:54:59,889 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting 1628452bcbc044978e89d0017623b719, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678805688805 2023-03-14 14:54:59,889 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting 389ec0d426554927a09b80e5c5eafe3e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678805690218 2023-03-14 14:54:59,890 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting 2d172296ef8b4d8dbfd4cee0d7d4608d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-03-14 14:54:59,900 INFO [Listener at localhost.localdomain/44261] throttle.PressureAwareThroughputController(145): 46b57114435577599b693b836e0ad8d2#family2#compaction#111 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-14 14:54:59,933 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1/c9bf5b936237414485b321f354149a3f, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1/a6062f3df98748bdabc1471e8d8f1031, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1/b19c3c6a9bf5422989ad34b1bd3dd634, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1/b3edf5484f304570ace5edaeaed6a1f1, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1/fb30151e338a4d5da08e95b962160290] to archive 2023-03-14 14:54:59,934 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 14:54:59,936 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1/c9bf5b936237414485b321f354149a3f to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1/c9bf5b936237414485b321f354149a3f 2023-03-14 14:54:59,938 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1/a6062f3df98748bdabc1471e8d8f1031 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1/a6062f3df98748bdabc1471e8d8f1031 2023-03-14 14:54:59,939 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1/b19c3c6a9bf5422989ad34b1bd3dd634 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1/b19c3c6a9bf5422989ad34b1bd3dd634 2023-03-14 14:54:59,940 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1/b3edf5484f304570ace5edaeaed6a1f1 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1/b3edf5484f304570ace5edaeaed6a1f1 2023-03-14 14:54:59,941 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1/fb30151e338a4d5da08e95b962160290 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1/fb30151e338a4d5da08e95b962160290 2023-03-14 14:55:00,318 INFO [Listener at localhost.localdomain/44261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230314025cd85bbe0849bd88254ca172e572d9_del 2023-03-14 14:55:00,319 INFO [Listener at localhost.localdomain/44261] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230314025cd85bbe0849bd88254ca172e572d9_del to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230314025cd85bbe0849bd88254ca172e572d9_del 2023-03-14 14:55:01,149 INFO [Listener at localhost.localdomain/44261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 22b77b7d10f8461898fa53197c91acdd 2023-03-14 14:55:01,150 DEBUG [Listener at localhost.localdomain/44261] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/.tmp/family2/22b77b7d10f8461898fa53197c91acdd as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family2/22b77b7d10f8461898fa53197c91acdd 2023-03-14 14:55:01,154 INFO [Listener at localhost.localdomain/44261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 22b77b7d10f8461898fa53197c91acdd 2023-03-14 14:55:01,155 INFO [Listener at localhost.localdomain/44261] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 46b57114435577599b693b836e0ad8d2/family2 of 46b57114435577599b693b836e0ad8d2 into 22b77b7d10f8461898fa53197c91acdd(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-14 14:55:01,156 DEBUG [Listener at localhost.localdomain/44261] regionserver.HRegion(2289): Compaction status journal for 46b57114435577599b693b836e0ad8d2: 2023-03-14 14:55:01,156 DEBUG [Listener at localhost.localdomain/44261] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-14 14:55:01,156 DEBUG [Listener at localhost.localdomain/44261] regionserver.HStore(1912): 541dfbe822716da662f3a573a64aa05f/family1 is initiating major compaction (all files) 2023-03-14 14:55:01,156 INFO [Listener at localhost.localdomain/44261] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-14 14:55:01,156 INFO [Listener at localhost.localdomain/44261] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-14 14:55:01,156 INFO [Listener at localhost.localdomain/44261] regionserver.HRegion(2259): Starting compaction of 541dfbe822716da662f3a573a64aa05f/family1 in testCompactionWithHFileLink,,1678805683037.541dfbe822716da662f3a573a64aa05f. 2023-03-14 14:55:01,156 INFO [Listener at localhost.localdomain/44261] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1/70e0f28062314487bee0b6ed2ce10d0b, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1/591c70d95e90448b9e60702762d6fe7b, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1/1b5ac87360aa4bb191cc4449750a7907, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1/3d7816c125124489b2759873bb2274f5, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1/b881c569dc0b411ba7f1b49938786aed] into tmpdir=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/.tmp, totalSize=26.7 K 2023-03-14 14:55:01,157 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting 70e0f28062314487bee0b6ed2ce10d0b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678805685166 2023-03-14 14:55:01,157 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting 591c70d95e90448b9e60702762d6fe7b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678805686981 2023-03-14 14:55:01,158 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting 1b5ac87360aa4bb191cc4449750a7907, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678805688804 2023-03-14 14:55:01,158 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting 3d7816c125124489b2759873bb2274f5, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678805690217 2023-03-14 14:55:01,159 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting b881c569dc0b411ba7f1b49938786aed, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-03-14 14:55:01,172 INFO [Listener at localhost.localdomain/44261] throttle.PressureAwareThroughputController(145): 541dfbe822716da662f3a573a64aa05f#family1#compaction#112 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-14 14:55:01,233 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family2/f50ca180804e42159fa65ddb96403962, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family2/b01622885e094dce84b6378c5e6e9a6f, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family2/1628452bcbc044978e89d0017623b719, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family2/389ec0d426554927a09b80e5c5eafe3e, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family2/2d172296ef8b4d8dbfd4cee0d7d4608d] to archive 2023-03-14 14:55:01,235 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 14:55:01,239 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family2/f50ca180804e42159fa65ddb96403962 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family2/f50ca180804e42159fa65ddb96403962 2023-03-14 14:55:01,242 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family2/b01622885e094dce84b6378c5e6e9a6f to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family2/b01622885e094dce84b6378c5e6e9a6f 2023-03-14 14:55:01,245 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family2/1628452bcbc044978e89d0017623b719 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family2/1628452bcbc044978e89d0017623b719 2023-03-14 14:55:01,246 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family2/389ec0d426554927a09b80e5c5eafe3e to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family2/389ec0d426554927a09b80e5c5eafe3e 2023-03-14 14:55:01,248 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family2/2d172296ef8b4d8dbfd4cee0d7d4608d to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family2/2d172296ef8b4d8dbfd4cee0d7d4608d 2023-03-14 14:55:01,588 INFO [Listener at localhost.localdomain/44261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230314f8190aff6580488992cd6358c2b34a73_del 2023-03-14 14:55:01,588 INFO [Listener at localhost.localdomain/44261] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230314f8190aff6580488992cd6358c2b34a73_del to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230314f8190aff6580488992cd6358c2b34a73_del 2023-03-14 14:55:02,419 INFO [Listener at localhost.localdomain/44261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 472d3d1682e444c397da153230d908ee 2023-03-14 14:55:02,420 DEBUG [Listener at localhost.localdomain/44261] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/.tmp/family1/472d3d1682e444c397da153230d908ee as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1/472d3d1682e444c397da153230d908ee 2023-03-14 14:55:02,425 INFO [Listener at localhost.localdomain/44261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 472d3d1682e444c397da153230d908ee 2023-03-14 14:55:02,426 INFO [Listener at localhost.localdomain/44261] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 541dfbe822716da662f3a573a64aa05f/family1 of 541dfbe822716da662f3a573a64aa05f into 472d3d1682e444c397da153230d908ee(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-14 14:55:02,426 DEBUG [Listener at localhost.localdomain/44261] regionserver.HRegion(2289): Compaction status journal for 541dfbe822716da662f3a573a64aa05f: 2023-03-14 14:55:02,426 DEBUG [Listener at localhost.localdomain/44261] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-14 14:55:02,426 DEBUG [Listener at localhost.localdomain/44261] regionserver.HStore(1912): 541dfbe822716da662f3a573a64aa05f/family2 is initiating major compaction (all files) 2023-03-14 14:55:02,427 INFO [Listener at localhost.localdomain/44261] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-14 14:55:02,427 INFO [Listener at localhost.localdomain/44261] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-14 14:55:02,427 INFO [Listener at localhost.localdomain/44261] regionserver.HRegion(2259): Starting compaction of 541dfbe822716da662f3a573a64aa05f/family2 in testCompactionWithHFileLink,,1678805683037.541dfbe822716da662f3a573a64aa05f. 2023-03-14 14:55:02,428 INFO [Listener at localhost.localdomain/44261] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family2/3a131025d2344260a03875522668b04a, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family2/04bf20de187e447d8cd4c89e4ba37610, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family2/55badc960cc24ee5ad7320c72ae33a8f, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family2/6c1df25b2a324da6a91f047c43539cd5, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family2/65278030232d45d2a277492949f0b63b] into tmpdir=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/.tmp, totalSize=25.4 K 2023-03-14 14:55:02,428 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting 3a131025d2344260a03875522668b04a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678805685166 2023-03-14 14:55:02,429 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting 04bf20de187e447d8cd4c89e4ba37610, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678805686981 2023-03-14 14:55:02,429 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting 55badc960cc24ee5ad7320c72ae33a8f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678805688804 2023-03-14 14:55:02,429 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting 6c1df25b2a324da6a91f047c43539cd5, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678805690217 2023-03-14 14:55:02,430 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting 65278030232d45d2a277492949f0b63b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-03-14 14:55:02,432 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1/70e0f28062314487bee0b6ed2ce10d0b, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1/591c70d95e90448b9e60702762d6fe7b, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1/1b5ac87360aa4bb191cc4449750a7907, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1/3d7816c125124489b2759873bb2274f5, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1/b881c569dc0b411ba7f1b49938786aed] to archive 2023-03-14 14:55:02,433 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 14:55:02,434 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1/70e0f28062314487bee0b6ed2ce10d0b to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1/70e0f28062314487bee0b6ed2ce10d0b 2023-03-14 14:55:02,436 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1/591c70d95e90448b9e60702762d6fe7b to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1/591c70d95e90448b9e60702762d6fe7b 2023-03-14 14:55:02,437 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1/1b5ac87360aa4bb191cc4449750a7907 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1/1b5ac87360aa4bb191cc4449750a7907 2023-03-14 14:55:02,438 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1/3d7816c125124489b2759873bb2274f5 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1/3d7816c125124489b2759873bb2274f5 2023-03-14 14:55:02,438 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1/b881c569dc0b411ba7f1b49938786aed to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1/b881c569dc0b411ba7f1b49938786aed 2023-03-14 14:55:02,440 INFO [Listener at localhost.localdomain/44261] throttle.PressureAwareThroughputController(145): 541dfbe822716da662f3a573a64aa05f#family2#compaction#113 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-14 14:55:02,855 INFO [Listener at localhost.localdomain/44261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202303140309dc40d9ce4d3d8d36a2aebaacb825_del 2023-03-14 14:55:02,855 INFO [Listener at localhost.localdomain/44261] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303140309dc40d9ce4d3d8d36a2aebaacb825_del to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202303140309dc40d9ce4d3d8d36a2aebaacb825_del 2023-03-14 14:55:03,680 INFO [Listener at localhost.localdomain/44261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ac72690052e84e8499b6bddc2c24c6e7 2023-03-14 14:55:03,681 DEBUG [Listener at localhost.localdomain/44261] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/.tmp/family2/ac72690052e84e8499b6bddc2c24c6e7 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family2/ac72690052e84e8499b6bddc2c24c6e7 2023-03-14 14:55:03,688 INFO [Listener at localhost.localdomain/44261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ac72690052e84e8499b6bddc2c24c6e7 2023-03-14 14:55:03,690 INFO [Listener at localhost.localdomain/44261] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 541dfbe822716da662f3a573a64aa05f/family2 of 541dfbe822716da662f3a573a64aa05f into ac72690052e84e8499b6bddc2c24c6e7(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-14 14:55:03,690 DEBUG [Listener at localhost.localdomain/44261] regionserver.HRegion(2289): Compaction status journal for 541dfbe822716da662f3a573a64aa05f: 2023-03-14 14:55:03,698 DEBUG [Listener at localhost.localdomain/44261] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-14 14:55:03,703 DEBUG [Listener at localhost.localdomain/44261] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-14 14:55:03,709 DEBUG [Listener at localhost.localdomain/44261] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-14 14:55:03,711 DEBUG [Listener at localhost.localdomain/44261] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-14 14:55:03,718 INFO [Listener at localhost.localdomain/44261] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-03-14 14:55:03,734 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family2/3a131025d2344260a03875522668b04a, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family2/04bf20de187e447d8cd4c89e4ba37610, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family2/55badc960cc24ee5ad7320c72ae33a8f, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family2/6c1df25b2a324da6a91f047c43539cd5, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family2/65278030232d45d2a277492949f0b63b] to archive 2023-03-14 14:55:03,735 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 14:55:03,736 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family2/3a131025d2344260a03875522668b04a to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family2/3a131025d2344260a03875522668b04a 2023-03-14 14:55:03,737 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family2/04bf20de187e447d8cd4c89e4ba37610 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family2/04bf20de187e447d8cd4c89e4ba37610 2023-03-14 14:55:03,738 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family2/55badc960cc24ee5ad7320c72ae33a8f to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family2/55badc960cc24ee5ad7320c72ae33a8f 2023-03-14 14:55:03,739 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family2/6c1df25b2a324da6a91f047c43539cd5 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family2/6c1df25b2a324da6a91f047c43539cd5 2023-03-14 14:55:03,740 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family2/65278030232d45d2a277492949f0b63b to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family2/65278030232d45d2a277492949f0b63b 2023-03-14 14:55:03,752 INFO [Listener at localhost.localdomain/44261] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-03-14 14:55:03,755 INFO [Listener at localhost.localdomain/44261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230314f8190aff6580488992cd6358c2b34a73_del 2023-03-14 14:55:03,758 INFO [Listener at localhost.localdomain/44261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230314df68625bc2a74f6ca9e097fb1dfc74c1_del 2023-03-14 14:55:03,760 INFO [Listener at localhost.localdomain/44261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230314664298466abd4b7d837b450694ceae9a_del 2023-03-14 14:55:03,760 INFO [Listener at localhost.localdomain/44261] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testCompactionWithHFileLink' column='family1' 2023-03-14 14:55:03,760 DEBUG [Listener at localhost.localdomain/44261] zookeeper.ReadOnlyZKClient(139): Connect 0x47167425 to 127.0.0.1:50211 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-14 14:55:03,764 DEBUG [Listener at localhost.localdomain/44261] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@b10b748, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-14 14:55:03,765 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230314 for table='testCompactionWithHFileLink' and column='family1' 2023-03-14 14:55:03,765 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230314 for table='testCompactionWithHFileLink' and column='family1' 2023-03-14 14:55:03,765 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230314 for table='testCompactionWithHFileLink' and column='family1' 2023-03-14 14:55:04,221 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023031491d15596ca6842978501a5f83650e676 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023031491d15596ca6842978501a5f83650e676 2023-03-14 14:55:04,222 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230314 table='testCompactionWithHFileLink' column='family1' 2023-03-14 14:55:04,235 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-14 14:55:04,238 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:37088, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-14 14:55:04,244 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-14 14:55:04,246 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:53404, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-14 14:55:04,254 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230314/family1/2c7c0a9a304c445a956c34d7bf0f37ac first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-03-14 14:55:04,255 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,,1678805683037.541dfbe822716da662f3a573a64aa05f., hostname=jenkins-hbase20.apache.org,41317,1678805580877, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230314/family1/2c7c0a9a304c445a956c34d7bf0f37ac}] 2023-03-14 14:55:04,260 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230314/family1/2c7c0a9a304c445a956c34d7bf0f37ac for inclusion in 541dfbe822716da662f3a573a64aa05f/family1 2023-03-14 14:55:04,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-03-14 14:55:04,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(777): Region bounds: first= last=1 2023-03-14 14:55:04,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HRegion(2446): Flush status journal for 541dfbe822716da662f3a573a64aa05f: 2023-03-14 14:55:04,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230314/family1/2c7c0a9a304c445a956c34d7bf0f37ac to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testCompactionWithHFileLink__alecjcajuhd4kenithr8adnjulqr9udgs1lrfv4jsf2no28j0mojtn7ac27tgkpf/family1/2c7c0a9a304c445a956c34d7bf0f37ac 2023-03-14 14:55:04,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testCompactionWithHFileLink__alecjcajuhd4kenithr8adnjulqr9udgs1lrfv4jsf2no28j0mojtn7ac27tgkpf/family1/2c7c0a9a304c445a956c34d7bf0f37ac as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1/fbb95b9d9ff84bacaa09c7758b87cc88_SeqId_29_ 2023-03-14 14:55:04,268 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testCompactionWithHFileLink__alecjcajuhd4kenithr8adnjulqr9udgs1lrfv4jsf2no28j0mojtn7ac27tgkpf/family1/2c7c0a9a304c445a956c34d7bf0f37ac into 541dfbe822716da662f3a573a64aa05f/family1 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1/fbb95b9d9ff84bacaa09c7758b87cc88_SeqId_29_ - updating store file list. 2023-03-14 14:55:04,272 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1/fbb95b9d9ff84bacaa09c7758b87cc88_SeqId_29_ into 541dfbe822716da662f3a573a64aa05f/family1 2023-03-14 14:55:04,272 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testCompactionWithHFileLink__alecjcajuhd4kenithr8adnjulqr9udgs1lrfv4jsf2no28j0mojtn7ac27tgkpf/family1/2c7c0a9a304c445a956c34d7bf0f37ac into 541dfbe822716da662f3a573a64aa05f/family1 (new location: hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1/fbb95b9d9ff84bacaa09c7758b87cc88_SeqId_29_) 2023-03-14 14:55:04,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testCompactionWithHFileLink__alecjcajuhd4kenithr8adnjulqr9udgs1lrfv4jsf2no28j0mojtn7ac27tgkpf/family1/2c7c0a9a304c445a956c34d7bf0f37ac 2023-03-14 14:55:04,275 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230314 table='testCompactionWithHFileLink' column='family1' 2023-03-14 14:55:04,276 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 14:55:04,277 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023031409ce4a6ddfb84b438695750db282e007 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023031409ce4a6ddfb84b438695750db282e007 2023-03-14 14:55:04,279 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023031454adfebd63414c198bff0e938bfc1e87 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023031454adfebd63414c198bff0e938bfc1e87 2023-03-14 14:55:04,280 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303149c8e68c75520486e8f847c138d0f55ce to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202303149c8e68c75520486e8f847c138d0f55ce 2023-03-14 14:55:04,282 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230314d71ba2d46f4e4de689ca125a16b89c45 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230314d71ba2d46f4e4de689ca125a16b89c45 2023-03-14 14:55:04,282 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-03-14 14:55:04,282 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230314' 2023-03-14 14:55:04,282 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230314 for table='testCompactionWithHFileLink' and column='family1' 2023-03-14 14:55:04,619 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230314737b7fa7a77c42e7a31dd76d17527f98 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230314737b7fa7a77c42e7a31dd76d17527f98 2023-03-14 14:55:04,620 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230314 table='testCompactionWithHFileLink' column='family1' 2023-03-14 14:55:04,630 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230314938e9d4bd05544478c66c8a1c3620b7e to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230314938e9d4bd05544478c66c8a1c3620b7e 2023-03-14 14:55:04,631 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230314 table='testCompactionWithHFileLink' column='family1' 2023-03-14 14:55:04,653 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230314/family1/0ddcb2b8a7f44b1caec1ac43b115fe8c first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-03-14 14:55:04,655 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,2,1678805683037.d03921af574c9e368e124258e08ab95d., hostname=jenkins-hbase20.apache.org,41317,1678805580877, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230314/family1/0ddcb2b8a7f44b1caec1ac43b115fe8c}] 2023-03-14 14:55:04,658 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230314/family1/0ddcb2b8a7f44b1caec1ac43b115fe8c for inclusion in d03921af574c9e368e124258e08ab95d/family1 2023-03-14 14:55:04,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-03-14 14:55:04,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(777): Region bounds: first=2 last= 2023-03-14 14:55:04,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HRegion(2446): Flush status journal for d03921af574c9e368e124258e08ab95d: 2023-03-14 14:55:04,661 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230314/family1/4bc17346d23d445db0990dad41561300 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-03-14 14:55:04,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230314/family1/0ddcb2b8a7f44b1caec1ac43b115fe8c to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testCompactionWithHFileLink__ccon4nrg2nmgts5etqc0u56g6k3q0p1sh06f3fckign9folh1tdiqka414l94ala/family1/0ddcb2b8a7f44b1caec1ac43b115fe8c 2023-03-14 14:55:04,662 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,1,1678805683037.46b57114435577599b693b836e0ad8d2., hostname=jenkins-hbase20.apache.org,41317,1678805580877, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230314/family1/4bc17346d23d445db0990dad41561300}] 2023-03-14 14:55:04,664 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230314/family1/4bc17346d23d445db0990dad41561300 for inclusion in 46b57114435577599b693b836e0ad8d2/family1 2023-03-14 14:55:04,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testCompactionWithHFileLink__ccon4nrg2nmgts5etqc0u56g6k3q0p1sh06f3fckign9folh1tdiqka414l94ala/family1/0ddcb2b8a7f44b1caec1ac43b115fe8c as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family1/6e4a72f0f87145d8add6c558545e76ce_SeqId_29_ 2023-03-14 14:55:04,665 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testCompactionWithHFileLink__ccon4nrg2nmgts5etqc0u56g6k3q0p1sh06f3fckign9folh1tdiqka414l94ala/family1/0ddcb2b8a7f44b1caec1ac43b115fe8c into d03921af574c9e368e124258e08ab95d/family1 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family1/6e4a72f0f87145d8add6c558545e76ce_SeqId_29_ - updating store file list. 2023-03-14 14:55:04,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-03-14 14:55:04,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HStore(777): Region bounds: first=1 last=2 2023-03-14 14:55:04,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HRegion(2446): Flush status journal for 46b57114435577599b693b836e0ad8d2: 2023-03-14 14:55:04,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230314/family1/4bc17346d23d445db0990dad41561300 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testCompactionWithHFileLink__j1a1herhviem01k9ejifmj46kp0hhn2mor4avaibcngcfocev5fe7vl1fbfotges/family1/4bc17346d23d445db0990dad41561300 2023-03-14 14:55:04,669 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family1/6e4a72f0f87145d8add6c558545e76ce_SeqId_29_ into d03921af574c9e368e124258e08ab95d/family1 2023-03-14 14:55:04,669 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testCompactionWithHFileLink__ccon4nrg2nmgts5etqc0u56g6k3q0p1sh06f3fckign9folh1tdiqka414l94ala/family1/0ddcb2b8a7f44b1caec1ac43b115fe8c into d03921af574c9e368e124258e08ab95d/family1 (new location: hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family1/6e4a72f0f87145d8add6c558545e76ce_SeqId_29_) 2023-03-14 14:55:04,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testCompactionWithHFileLink__ccon4nrg2nmgts5etqc0u56g6k3q0p1sh06f3fckign9folh1tdiqka414l94ala/family1/0ddcb2b8a7f44b1caec1ac43b115fe8c 2023-03-14 14:55:04,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testCompactionWithHFileLink__j1a1herhviem01k9ejifmj46kp0hhn2mor4avaibcngcfocev5fe7vl1fbfotges/family1/4bc17346d23d445db0990dad41561300 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1/020b222f8db04056ba4c2931222a8495_SeqId_29_ 2023-03-14 14:55:04,671 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230314 table='testCompactionWithHFileLink' column='family1' 2023-03-14 14:55:04,674 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 14:55:04,674 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testCompactionWithHFileLink__j1a1herhviem01k9ejifmj46kp0hhn2mor4avaibcngcfocev5fe7vl1fbfotges/family1/4bc17346d23d445db0990dad41561300 into 46b57114435577599b693b836e0ad8d2/family1 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1/020b222f8db04056ba4c2931222a8495_SeqId_29_ - updating store file list. 2023-03-14 14:55:04,676 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230314166d9758f1064d329f3c4b65a7ba8729 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230314166d9758f1064d329f3c4b65a7ba8729 2023-03-14 14:55:04,676 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303145ee28b82bdc245389b68cc7d9e252743 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202303145ee28b82bdc245389b68cc7d9e252743 2023-03-14 14:55:04,677 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230314976e5048cf584ab8bdad3c00af0cd325 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230314976e5048cf584ab8bdad3c00af0cd325 2023-03-14 14:55:04,677 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1/020b222f8db04056ba4c2931222a8495_SeqId_29_ into 46b57114435577599b693b836e0ad8d2/family1 2023-03-14 14:55:04,678 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testCompactionWithHFileLink__j1a1herhviem01k9ejifmj46kp0hhn2mor4avaibcngcfocev5fe7vl1fbfotges/family1/4bc17346d23d445db0990dad41561300 into 46b57114435577599b693b836e0ad8d2/family1 (new location: hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1/020b222f8db04056ba4c2931222a8495_SeqId_29_) 2023-03-14 14:55:04,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testCompactionWithHFileLink__j1a1herhviem01k9ejifmj46kp0hhn2mor4avaibcngcfocev5fe7vl1fbfotges/family1/4bc17346d23d445db0990dad41561300 2023-03-14 14:55:04,678 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230314b353e02f869a49458bca945e03232f09 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230314b353e02f869a49458bca945e03232f09 2023-03-14 14:55:04,678 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-03-14 14:55:04,678 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230314' 2023-03-14 14:55:04,679 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230314 for table='testCompactionWithHFileLink' and column='family1' 2023-03-14 14:55:04,680 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230314 table='testCompactionWithHFileLink' column='family1' 2023-03-14 14:55:04,680 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 14:55:04,681 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303140793053a07d1492b94e2f50baefaf1e0 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303140793053a07d1492b94e2f50baefaf1e0 2023-03-14 14:55:04,682 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303144f70f82c217d488083d264a4438a183c to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303144f70f82c217d488083d264a4438a183c 2023-03-14 14:55:04,683 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230314a5917ff88234474e908ccfc6684a0e94 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230314a5917ff88234474e908ccfc6684a0e94 2023-03-14 14:55:04,684 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230314c26db956b7364b62b4786bde77df793b to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230314c26db956b7364b62b4786bde77df793b 2023-03-14 14:55:04,684 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-03-14 14:55:04,684 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230314' 2023-03-14 14:55:04,685 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230314 for table='testCompactionWithHFileLink' and column='family1' 2023-03-14 14:55:04,685 INFO [Listener at localhost.localdomain/44261] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-03-14 14:55:04,685 INFO [Listener at localhost.localdomain/44261] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testCompactionWithHFileLink' and column='family1' 2023-03-14 14:55:04,685 INFO [Listener at localhost.localdomain/44261] compactions.PartitionedMobCompactor(367): [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230314f8190aff6580488992cd6358c2b34a73_del] 2023-03-14 14:55:04,685 DEBUG [Listener at localhost.localdomain/44261] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 14:55:04,686 DEBUG [Listener at localhost.localdomain/44261] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230314f8190aff6580488992cd6358c2b34a73_del to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230314f8190aff6580488992cd6358c2b34a73_del 2023-03-14 14:55:04,686 INFO [Listener at localhost.localdomain/44261] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-03-14 14:55:04,687 INFO [Listener at localhost.localdomain/44261] compactions.PartitionedMobCompactor(367): [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230314df68625bc2a74f6ca9e097fb1dfc74c1_del] 2023-03-14 14:55:04,687 DEBUG [Listener at localhost.localdomain/44261] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 14:55:04,688 DEBUG [Listener at localhost.localdomain/44261] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230314df68625bc2a74f6ca9e097fb1dfc74c1_del to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230314df68625bc2a74f6ca9e097fb1dfc74c1_del 2023-03-14 14:55:04,688 INFO [Listener at localhost.localdomain/44261] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-03-14 14:55:04,688 INFO [Listener at localhost.localdomain/44261] compactions.PartitionedMobCompactor(367): [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230314664298466abd4b7d837b450694ceae9a_del] 2023-03-14 14:55:04,688 DEBUG [Listener at localhost.localdomain/44261] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 14:55:04,689 DEBUG [Listener at localhost.localdomain/44261] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230314664298466abd4b7d837b450694ceae9a_del to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230314664298466abd4b7d837b450694ceae9a_del 2023-03-14 14:55:04,689 INFO [Listener at localhost.localdomain/44261] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-03-14 14:55:04,693 DEBUG [Listener at localhost.localdomain/44261] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-14 14:55:04,696 DEBUG [Listener at localhost.localdomain/44261] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-14 14:55:04,700 DEBUG [Listener at localhost.localdomain/44261] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-14 14:55:04,701 DEBUG [Listener at localhost.localdomain/44261] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-14 14:55:04,707 INFO [Listener at localhost.localdomain/44261] client.HBaseAdmin$15(890): Started disable of testCompactionWithHFileLink 2023-03-14 14:55:04,707 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testCompactionWithHFileLink 2023-03-14 14:55:04,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure2.ProcedureExecutor(1029): Stored pid=88, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testCompactionWithHFileLink 2023-03-14 14:55:04,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-03-14 14:55:04,710 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678805704710"}]},"ts":"1678805704710"} 2023-03-14 14:55:04,711 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLING in hbase:meta 2023-03-14 14:55:04,712 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testCompactionWithHFileLink to state=DISABLING 2023-03-14 14:55:04,713 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=541dfbe822716da662f3a573a64aa05f, UNASSIGN}, {pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=46b57114435577599b693b836e0ad8d2, UNASSIGN}, {pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=d03921af574c9e368e124258e08ab95d, UNASSIGN}] 2023-03-14 14:55:04,714 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=46b57114435577599b693b836e0ad8d2, UNASSIGN 2023-03-14 14:55:04,715 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=d03921af574c9e368e124258e08ab95d, UNASSIGN 2023-03-14 14:55:04,715 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=541dfbe822716da662f3a573a64aa05f, UNASSIGN 2023-03-14 14:55:04,715 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=46b57114435577599b693b836e0ad8d2, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:04,715 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=d03921af574c9e368e124258e08ab95d, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:04,715 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=541dfbe822716da662f3a573a64aa05f, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:04,716 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1678805683037.46b57114435577599b693b836e0ad8d2.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678805704715"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1678805704715"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678805704715"}]},"ts":"1678805704715"} 2023-03-14 14:55:04,716 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1678805683037.541dfbe822716da662f3a573a64aa05f.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678805704715"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1678805704715"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678805704715"}]},"ts":"1678805704715"} 2023-03-14 14:55:04,716 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1678805683037.d03921af574c9e368e124258e08ab95d.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678805704715"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1678805704715"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678805704715"}]},"ts":"1678805704715"} 2023-03-14 14:55:04,717 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=92, ppid=89, state=RUNNABLE; CloseRegionProcedure 541dfbe822716da662f3a573a64aa05f, server=jenkins-hbase20.apache.org,41317,1678805580877}] 2023-03-14 14:55:04,717 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; CloseRegionProcedure d03921af574c9e368e124258e08ab95d, server=jenkins-hbase20.apache.org,41317,1678805580877}] 2023-03-14 14:55:04,718 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=90, state=RUNNABLE; CloseRegionProcedure 46b57114435577599b693b836e0ad8d2, server=jenkins-hbase20.apache.org,41317,1678805580877}] 2023-03-14 14:55:04,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-03-14 14:55:04,869 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 46b57114435577599b693b836e0ad8d2 2023-03-14 14:55:04,869 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 46b57114435577599b693b836e0ad8d2, disabling compactions & flushes 2023-03-14 14:55:04,869 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1678805683037.46b57114435577599b693b836e0ad8d2. 2023-03-14 14:55:04,869 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1678805683037.46b57114435577599b693b836e0ad8d2. 2023-03-14 14:55:04,869 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1678805683037.46b57114435577599b693b836e0ad8d2. after waiting 0 ms 2023-03-14 14:55:04,869 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1678805683037.46b57114435577599b693b836e0ad8d2. 2023-03-14 14:55:04,873 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-03-14 14:55:04,874 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1678805683037.46b57114435577599b693b836e0ad8d2. 2023-03-14 14:55:04,874 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 46b57114435577599b693b836e0ad8d2: 2023-03-14 14:55:04,875 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 46b57114435577599b693b836e0ad8d2 2023-03-14 14:55:04,875 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close d03921af574c9e368e124258e08ab95d 2023-03-14 14:55:04,875 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing d03921af574c9e368e124258e08ab95d, disabling compactions & flushes 2023-03-14 14:55:04,875 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1678805683037.d03921af574c9e368e124258e08ab95d. 2023-03-14 14:55:04,875 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1678805683037.d03921af574c9e368e124258e08ab95d. 2023-03-14 14:55:04,875 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1678805683037.d03921af574c9e368e124258e08ab95d. after waiting 0 ms 2023-03-14 14:55:04,875 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1678805683037.d03921af574c9e368e124258e08ab95d. 2023-03-14 14:55:04,875 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=46b57114435577599b693b836e0ad8d2, regionState=CLOSED 2023-03-14 14:55:04,876 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1678805683037.46b57114435577599b693b836e0ad8d2.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678805704875"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678805704875"}]},"ts":"1678805704875"} 2023-03-14 14:55:04,878 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=90 2023-03-14 14:55:04,878 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=90, state=SUCCESS; CloseRegionProcedure 46b57114435577599b693b836e0ad8d2, server=jenkins-hbase20.apache.org,41317,1678805580877 in 159 msec 2023-03-14 14:55:04,880 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=90, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=46b57114435577599b693b836e0ad8d2, UNASSIGN in 165 msec 2023-03-14 14:55:04,881 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-03-14 14:55:04,882 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1678805683037.d03921af574c9e368e124258e08ab95d. 2023-03-14 14:55:04,882 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for d03921af574c9e368e124258e08ab95d: 2023-03-14 14:55:04,883 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed d03921af574c9e368e124258e08ab95d 2023-03-14 14:55:04,884 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 541dfbe822716da662f3a573a64aa05f 2023-03-14 14:55:04,884 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 541dfbe822716da662f3a573a64aa05f, disabling compactions & flushes 2023-03-14 14:55:04,884 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1678805683037.541dfbe822716da662f3a573a64aa05f. 2023-03-14 14:55:04,884 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1678805683037.541dfbe822716da662f3a573a64aa05f. 2023-03-14 14:55:04,884 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1678805683037.541dfbe822716da662f3a573a64aa05f. after waiting 0 ms 2023-03-14 14:55:04,884 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1678805683037.541dfbe822716da662f3a573a64aa05f. 2023-03-14 14:55:04,884 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=d03921af574c9e368e124258e08ab95d, regionState=CLOSED 2023-03-14 14:55:04,884 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1678805683037.d03921af574c9e368e124258e08ab95d.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678805704884"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678805704884"}]},"ts":"1678805704884"} 2023-03-14 14:55:04,887 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=91 2023-03-14 14:55:04,887 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=91, state=SUCCESS; CloseRegionProcedure d03921af574c9e368e124258e08ab95d, server=jenkins-hbase20.apache.org,41317,1678805580877 in 168 msec 2023-03-14 14:55:04,887 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=d03921af574c9e368e124258e08ab95d, UNASSIGN in 174 msec 2023-03-14 14:55:04,890 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-03-14 14:55:04,890 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1678805683037.541dfbe822716da662f3a573a64aa05f. 2023-03-14 14:55:04,890 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 541dfbe822716da662f3a573a64aa05f: 2023-03-14 14:55:04,892 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 541dfbe822716da662f3a573a64aa05f 2023-03-14 14:55:04,892 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=541dfbe822716da662f3a573a64aa05f, regionState=CLOSED 2023-03-14 14:55:04,892 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1678805683037.541dfbe822716da662f3a573a64aa05f.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678805704892"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678805704892"}]},"ts":"1678805704892"} 2023-03-14 14:55:04,894 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=89 2023-03-14 14:55:04,894 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=89, state=SUCCESS; CloseRegionProcedure 541dfbe822716da662f3a573a64aa05f, server=jenkins-hbase20.apache.org,41317,1678805580877 in 176 msec 2023-03-14 14:55:04,895 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=89, resume processing ppid=88 2023-03-14 14:55:04,895 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=89, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=541dfbe822716da662f3a573a64aa05f, UNASSIGN in 181 msec 2023-03-14 14:55:04,896 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678805704896"}]},"ts":"1678805704896"} 2023-03-14 14:55:04,897 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLED in hbase:meta 2023-03-14 14:55:04,898 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testCompactionWithHFileLink to state=DISABLED 2023-03-14 14:55:04,899 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=88, state=SUCCESS; DisableTableProcedure table=testCompactionWithHFileLink in 191 msec 2023-03-14 14:55:05,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-03-14 14:55:05,013 INFO [Listener at localhost.localdomain/44261] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testCompactionWithHFileLink, procId: 88 completed 2023-03-14 14:55:05,024 INFO [Listener at localhost.localdomain/44261] client.HBaseAdmin(2586): Taking restore-failsafe snapshot: hbase-failsafe-snaptb-1678805692027-1678805705024 2023-03-14 14:55:05,025 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1580): Client=jenkins//148.251.75.209 snapshot request for:{ ss=hbase-failsafe-snaptb-1678805692027-1678805705024 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-14 14:55:05,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1678805705025 (current time:1678805705025). 2023-03-14 14:55:05,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-03-14 14:55:05,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] zookeeper.ReadOnlyZKClient(139): Connect 0x6eab27b1 to 127.0.0.1:50211 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-14 14:55:05,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@d9cea14, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-14 14:55:05,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-14 14:55:05,036 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:37092, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-14 14:55:05,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6eab27b1 to 127.0.0.1:50211 2023-03-14 14:55:05,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-14 14:55:05,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-03-14 14:55:05,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] snapshot.SnapshotManager(659): Table is disabled, running snapshot entirely on master for { ss=hbase-failsafe-snaptb-1678805692027-1678805705024 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-14 14:55:05,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-03-14 14:55:05,040 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-03-14 14:55:05,041 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1678806305041 2023-03-14 14:55:05,041 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running DISABLED table snapshot hbase-failsafe-snaptb-1678805692027-1678805705024 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-03-14 14:55:05,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] snapshot.SnapshotManager(664): Started snapshot: { ss=hbase-failsafe-snaptb-1678805692027-1678805705024 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-14 14:55:05,042 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=hbase-failsafe-snaptb-1678805692027-1678805705024 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-03-14 14:55:05,042 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-03-14 14:55:05,142 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-14 14:55:05,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1678805692027-1678805705024 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-14 14:55:05,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1678805692027-1678805705024 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-14 14:55:05,144 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-03-14 14:55:05,344 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-14 14:55:05,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1678805692027-1678805705024 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-14 14:55:05,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1678805692027-1678805705024 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-14 14:55:05,345 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-03-14 14:55:05,458 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.DisabledTableSnapshotHandler(97): Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1678805692027-1678805705024 table=testCompactionWithHFileLink type=DISABLED ttl=0 } 2023-03-14 14:55:05,461 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-03-14 14:55:05,461 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-03-14 14:55:05,462 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-03-14 14:55:05,462 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-03-14 14:55:05,462 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-03-14 14:55:05,462 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-03-14 14:55:05,462 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-03-14 14:55:05,462 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-03-14 14:55:05,470 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1/472d3d1682e444c397da153230d908ee, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1/fbb95b9d9ff84bacaa09c7758b87cc88_SeqId_29_] hfiles 2023-03-14 14:55:05,470 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family1/014615fb0fa34bb4a0687a5e9ccd717c, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family1/6e4a72f0f87145d8add6c558545e76ce_SeqId_29_] hfiles 2023-03-14 14:55:05,470 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1/472d3d1682e444c397da153230d908ee 2023-03-14 14:55:05,470 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family1/014615fb0fa34bb4a0687a5e9ccd717c 2023-03-14 14:55:05,470 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1/fbb95b9d9ff84bacaa09c7758b87cc88_SeqId_29_ 2023-03-14 14:55:05,470 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1/020b222f8db04056ba4c2931222a8495_SeqId_29_, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1/31ab69da4fb54927a409b390e3eff93c] hfiles 2023-03-14 14:55:05,470 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230314938e9d4bd05544478c66c8a1c3620b7e, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230314737b7fa7a77c42e7a31dd76d17527f98, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023031491d15596ca6842978501a5f83650e676] hfiles 2023-03-14 14:55:05,470 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family1/6e4a72f0f87145d8add6c558545e76ce_SeqId_29_ 2023-03-14 14:55:05,471 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/3): hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230314938e9d4bd05544478c66c8a1c3620b7e 2023-03-14 14:55:05,471 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1/020b222f8db04056ba4c2931222a8495_SeqId_29_ 2023-03-14 14:55:05,471 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/3): hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230314737b7fa7a77c42e7a31dd76d17527f98 2023-03-14 14:55:05,471 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1/31ab69da4fb54927a409b390e3eff93c 2023-03-14 14:55:05,471 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/3): hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023031491d15596ca6842978501a5f83650e676 2023-03-14 14:55:05,471 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family2/50402a68999a42db8b5fd2da13f8cd53] hfiles 2023-03-14 14:55:05,471 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family2/ac72690052e84e8499b6bddc2c24c6e7] hfiles 2023-03-14 14:55:05,471 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family2/22b77b7d10f8461898fa53197c91acdd] hfiles 2023-03-14 14:55:05,471 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family2/22b77b7d10f8461898fa53197c91acdd 2023-03-14 14:55:05,471 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family2/ac72690052e84e8499b6bddc2c24c6e7 2023-03-14 14:55:05,471 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family2/50402a68999a42db8b5fd2da13f8cd53 2023-03-14 14:55:05,475 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230314025cd85bbe0849bd88254ca172e572d9_del, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303145a943fa5bcc34dcbb791de97f3d197d7, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303147f4ba9a482cf4d1da182ae7bd70c57a6, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023031483e30a1951464765bcc5de07d8fb6026, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230314f33f5277e1e343218385288838cf2e73, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230314265d06ea88ef49fa8b4abd0ab50b8535, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202303144bff8261664046c187eb07e2237022fe, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230314a2bf094ca161465eb35609449840a3eb, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230314b7bd66a1d9b845239012f68a9805ebbf_del, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230314ec67fccb67af477e9088878826566c06, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202303140309dc40d9ce4d3d8d36a2aebaacb825_del, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230314215fbbd5c34a46138b7ef9d25f00f3ed, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230314270c91d86df24c9cafb1962842b0a97f, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202303145b6cbf9af4e542ad9fb96522f2d38b9d, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230314d6712bf865914adf9b8f5b3b39a2c79e] hfiles 2023-03-14 14:55:05,475 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/15): hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230314025cd85bbe0849bd88254ca172e572d9_del 2023-03-14 14:55:05,475 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/15): hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303145a943fa5bcc34dcbb791de97f3d197d7 2023-03-14 14:55:05,476 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/15): hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202303147f4ba9a482cf4d1da182ae7bd70c57a6 2023-03-14 14:55:05,476 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (4/15): hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023031483e30a1951464765bcc5de07d8fb6026 2023-03-14 14:55:05,476 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (5/15): hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230314f33f5277e1e343218385288838cf2e73 2023-03-14 14:55:05,476 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (6/15): hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230314265d06ea88ef49fa8b4abd0ab50b8535 2023-03-14 14:55:05,476 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (7/15): hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202303144bff8261664046c187eb07e2237022fe 2023-03-14 14:55:05,476 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (8/15): hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230314a2bf094ca161465eb35609449840a3eb 2023-03-14 14:55:05,476 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (9/15): hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230314b7bd66a1d9b845239012f68a9805ebbf_del 2023-03-14 14:55:05,476 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (10/15): hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230314ec67fccb67af477e9088878826566c06 2023-03-14 14:55:05,476 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (11/15): hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202303140309dc40d9ce4d3d8d36a2aebaacb825_del 2023-03-14 14:55:05,476 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (12/15): hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230314215fbbd5c34a46138b7ef9d25f00f3ed 2023-03-14 14:55:05,476 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (13/15): hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230314270c91d86df24c9cafb1962842b0a97f 2023-03-14 14:55:05,476 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (14/15): hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202303145b6cbf9af4e542ad9fb96522f2d38b9d 2023-03-14 14:55:05,476 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (15/15): hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230314d6712bf865914adf9b8f5b3b39a2c79e 2023-03-14 14:55:05,646 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-14 14:55:05,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1678805692027-1678805705024 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-14 14:55:05,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1678805692027-1678805705024 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-14 14:55:05,648 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-03-14 14:55:05,884 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.DisabledTableSnapshotHandler(120): Marking snapshot{ ss=hbase-failsafe-snaptb-1678805692027-1678805705024 table=testCompactionWithHFileLink type=DISABLED ttl=0 } as finished. 2023-03-14 14:55:05,885 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for hbase-failsafe-snaptb-1678805692027-1678805705024 2023-03-14 14:55:05,886 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1678805692027-1678805705024 2023-03-14 14:55:06,148 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-14 14:55:06,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1678805692027-1678805705024 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-14 14:55:06,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1678805692027-1678805705024 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-03-14 14:55:06,150 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-03-14 14:55:06,322 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1678805692027-1678805705024 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.hbase-snapshot/hbase-failsafe-snaptb-1678805692027-1678805705024 2023-03-14 14:55:07,144 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot hbase-failsafe-snaptb-1678805692027-1678805705024 of table testCompactionWithHFileLink completed 2023-03-14 14:55:07,144 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1678805692027-1678805705024 2023-03-14 14:55:07,145 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1678805692027-1678805705024 2023-03-14 14:55:07,145 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running DISABLED table snapshot hbase-failsafe-snaptb-1678805692027-1678805705024 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1678805705041Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1678805692027-1678805705024 table=testCompactionWithHFileLink type=DISABLED ttl=0 } at 1678805705458 (+417 ms)Consolidate snapshot: hbase-failsafe-snaptb-1678805692027-1678805705024 at 1678805705885 (+427 ms)Loading Region manifests for hbase-failsafe-snaptb-1678805692027-1678805705024 at 1678805705885Writing data manifest for hbase-failsafe-snaptb-1678805692027-1678805705024 at 1678805705891 (+6 ms)Verifying snapshot: hbase-failsafe-snaptb-1678805692027-1678805705024 at 1678805706301 (+410 ms)Snapshot hbase-failsafe-snaptb-1678805692027-1678805705024 of table testCompactionWithHFileLink completed at 1678805707144 (+843 ms) 2023-03-14 14:55:07,146 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-03-14 14:55:07,148 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 2.1070 sec 2023-03-14 14:55:07,150 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-03-14 14:55:07,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1678805692027-1678805705024 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-03-14 14:55:07,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] snapshot.SnapshotManager(401): Snapshot '{ ss=hbase-failsafe-snaptb-1678805692027-1678805705024 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-03-14 14:55:07,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE:RESTORE_SNAPSHOT_PRE_OPERATION; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1678805692027" table: "testCompactionWithHFileLink" creation_time: 1678805692041 type: FLUSH version: 2 ttl: 0 ) 2023-03-14 14:55:07,188 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] snapshot.SnapshotManager(880): Restore snapshot=snaptb-1678805692027 as table=testCompactionWithHFileLink 2023-03-14 14:55:07,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-03-14 14:55:07,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-03-14 14:55:07,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-03-14 14:55:07,600 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-03-14 14:55:07,602 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-03-14 14:55:07,602 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-03-14 14:55:07,604 INFO [PEWorker-1] procedure.RestoreSnapshotProcedure(374): Starting restore snapshot={ ss=snaptb-1678805692027 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-03-14 14:55:07,613 INFO [PEWorker-1] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "snaptb-1678805692027" table: "testCompactionWithHFileLink" creation_time: 1678805692041 type: FLUSH version: 2 ttl: 0 2023-03-14 14:55:07,614 DEBUG [PEWorker-1] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink 2023-03-14 14:55:07,619 DEBUG [PEWorker-1] snapshot.RestoreSnapshotHelper(797): found 3 regions for table=testCompactionWithHFileLink 2023-03-14 14:55:07,622 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230314938e9d4bd05544478c66c8a1c3620b7e to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230314938e9d4bd05544478c66c8a1c3620b7e 2023-03-14 14:55:07,624 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230314737b7fa7a77c42e7a31dd76d17527f98 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230314737b7fa7a77c42e7a31dd76d17527f98 2023-03-14 14:55:07,625 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023031491d15596ca6842978501a5f83650e676 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023031491d15596ca6842978501a5f83650e676 2023-03-14 14:55:07,625 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b202303140793053a07d1492b94e2f50baefaf1e0 of snapshot=snaptb-1678805692027 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-14 14:55:07,629 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b202303144f70f82c217d488083d264a4438a183c of snapshot=snaptb-1678805692027 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-14 14:55:07,633 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20230314a5917ff88234474e908ccfc6684a0e94 of snapshot=snaptb-1678805692027 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-14 14:55:07,637 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20230314c26db956b7364b62b4786bde77df793b of snapshot=snaptb-1678805692027 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-14 14:55:07,639 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20230314166d9758f1064d329f3c4b65a7ba8729 of snapshot=snaptb-1678805692027 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-14 14:55:07,642 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c202303145ee28b82bdc245389b68cc7d9e252743 of snapshot=snaptb-1678805692027 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-14 14:55:07,644 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20230314976e5048cf584ab8bdad3c00af0cd325 of snapshot=snaptb-1678805692027 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-14 14:55:07,646 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20230314b353e02f869a49458bca945e03232f09 of snapshot=snaptb-1678805692027 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-14 14:55:07,649 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e2023031409ce4a6ddfb84b438695750db282e007 of snapshot=snaptb-1678805692027 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-14 14:55:07,652 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e2023031454adfebd63414c198bff0e938bfc1e87 of snapshot=snaptb-1678805692027 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-14 14:55:07,655 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e202303149c8e68c75520486e8f847c138d0f55ce of snapshot=snaptb-1678805692027 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-14 14:55:07,659 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20230314d71ba2d46f4e4de689ca125a16b89c45 of snapshot=snaptb-1678805692027 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-03-14 14:55:07,664 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202303140309dc40d9ce4d3d8d36a2aebaacb825_del to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202303140309dc40d9ce4d3d8d36a2aebaacb825_del 2023-03-14 14:55:07,665 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230314025cd85bbe0849bd88254ca172e572d9_del to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230314025cd85bbe0849bd88254ca172e572d9_del 2023-03-14 14:55:07,666 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230314b7bd66a1d9b845239012f68a9805ebbf_del to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230314b7bd66a1d9b845239012f68a9805ebbf_del 2023-03-14 14:55:07,667 INFO [PEWorker-1] snapshot.RestoreSnapshotHelper(223): region to restore: 46b57114435577599b693b836e0ad8d2 2023-03-14 14:55:07,667 INFO [PEWorker-1] snapshot.RestoreSnapshotHelper(223): region to restore: 541dfbe822716da662f3a573a64aa05f 2023-03-14 14:55:07,667 INFO [PEWorker-1] snapshot.RestoreSnapshotHelper(223): region to restore: d03921af574c9e368e124258e08ab95d 2023-03-14 14:55:07,670 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family1/014615fb0fa34bb4a0687a5e9ccd717c to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family1/014615fb0fa34bb4a0687a5e9ccd717c 2023-03-14 14:55:07,670 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1/472d3d1682e444c397da153230d908ee to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1/472d3d1682e444c397da153230d908ee 2023-03-14 14:55:07,670 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1/020b222f8db04056ba4c2931222a8495_SeqId_29_ to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1/020b222f8db04056ba4c2931222a8495_SeqId_29_ 2023-03-14 14:55:07,671 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family1/6e4a72f0f87145d8add6c558545e76ce_SeqId_29_ to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family1/6e4a72f0f87145d8add6c558545e76ce_SeqId_29_ 2023-03-14 14:55:07,671 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 7bedf33c34414f65b99ef964dca782ad of snapshot=snaptb-1678805692027 to region=d03921af574c9e368e124258e08ab95d table=testCompactionWithHFileLink 2023-03-14 14:55:07,671 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1/fbb95b9d9ff84bacaa09c7758b87cc88_SeqId_29_ to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1/fbb95b9d9ff84bacaa09c7758b87cc88_SeqId_29_ 2023-03-14 14:55:07,671 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 70e0f28062314487bee0b6ed2ce10d0b of snapshot=snaptb-1678805692027 to region=541dfbe822716da662f3a573a64aa05f table=testCompactionWithHFileLink 2023-03-14 14:55:07,672 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1/31ab69da4fb54927a409b390e3eff93c to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1/31ab69da4fb54927a409b390e3eff93c 2023-03-14 14:55:07,672 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c9bf5b936237414485b321f354149a3f of snapshot=snaptb-1678805692027 to region=46b57114435577599b693b836e0ad8d2 table=testCompactionWithHFileLink 2023-03-14 14:55:07,686 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 25a93ba0de464a7680c159909c51660b of snapshot=snaptb-1678805692027 to region=d03921af574c9e368e124258e08ab95d table=testCompactionWithHFileLink 2023-03-14 14:55:07,686 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 591c70d95e90448b9e60702762d6fe7b of snapshot=snaptb-1678805692027 to region=541dfbe822716da662f3a573a64aa05f table=testCompactionWithHFileLink 2023-03-14 14:55:07,686 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink a6062f3df98748bdabc1471e8d8f1031 of snapshot=snaptb-1678805692027 to region=46b57114435577599b693b836e0ad8d2 table=testCompactionWithHFileLink 2023-03-14 14:55:07,689 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink b19c3c6a9bf5422989ad34b1bd3dd634 of snapshot=snaptb-1678805692027 to region=46b57114435577599b693b836e0ad8d2 table=testCompactionWithHFileLink 2023-03-14 14:55:07,689 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 0d78103959d84c55bf5fd402a71523ff of snapshot=snaptb-1678805692027 to region=d03921af574c9e368e124258e08ab95d table=testCompactionWithHFileLink 2023-03-14 14:55:07,689 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 1b5ac87360aa4bb191cc4449750a7907 of snapshot=snaptb-1678805692027 to region=541dfbe822716da662f3a573a64aa05f table=testCompactionWithHFileLink 2023-03-14 14:55:07,691 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink b3edf5484f304570ace5edaeaed6a1f1 of snapshot=snaptb-1678805692027 to region=46b57114435577599b693b836e0ad8d2 table=testCompactionWithHFileLink 2023-03-14 14:55:07,691 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink ef4e5b48bebf48c4a6d53a9834e30bb5 of snapshot=snaptb-1678805692027 to region=d03921af574c9e368e124258e08ab95d table=testCompactionWithHFileLink 2023-03-14 14:55:07,691 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 3d7816c125124489b2759873bb2274f5 of snapshot=snaptb-1678805692027 to region=541dfbe822716da662f3a573a64aa05f table=testCompactionWithHFileLink 2023-03-14 14:55:07,701 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family2/50402a68999a42db8b5fd2da13f8cd53 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family2/50402a68999a42db8b5fd2da13f8cd53 2023-03-14 14:55:07,701 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink a8d3d3d688f44d5c98b54f77a810edfb of snapshot=snaptb-1678805692027 to region=d03921af574c9e368e124258e08ab95d table=testCompactionWithHFileLink 2023-03-14 14:55:07,701 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family2/22b77b7d10f8461898fa53197c91acdd to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family2/22b77b7d10f8461898fa53197c91acdd 2023-03-14 14:55:07,702 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family2/ac72690052e84e8499b6bddc2c24c6e7 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family2/ac72690052e84e8499b6bddc2c24c6e7 2023-03-14 14:55:07,702 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 3a131025d2344260a03875522668b04a of snapshot=snaptb-1678805692027 to region=541dfbe822716da662f3a573a64aa05f table=testCompactionWithHFileLink 2023-03-14 14:55:07,702 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink f50ca180804e42159fa65ddb96403962 of snapshot=snaptb-1678805692027 to region=46b57114435577599b693b836e0ad8d2 table=testCompactionWithHFileLink 2023-03-14 14:55:07,704 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink a25e279e24aa4b70919faaa31a07769a of snapshot=snaptb-1678805692027 to region=d03921af574c9e368e124258e08ab95d table=testCompactionWithHFileLink 2023-03-14 14:55:07,704 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 04bf20de187e447d8cd4c89e4ba37610 of snapshot=snaptb-1678805692027 to region=541dfbe822716da662f3a573a64aa05f table=testCompactionWithHFileLink 2023-03-14 14:55:07,704 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink b01622885e094dce84b6378c5e6e9a6f of snapshot=snaptb-1678805692027 to region=46b57114435577599b693b836e0ad8d2 table=testCompactionWithHFileLink 2023-03-14 14:55:07,707 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 55badc960cc24ee5ad7320c72ae33a8f of snapshot=snaptb-1678805692027 to region=541dfbe822716da662f3a573a64aa05f table=testCompactionWithHFileLink 2023-03-14 14:55:07,707 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 9a13180cb0db4dbd970bf225dcab0e4c of snapshot=snaptb-1678805692027 to region=d03921af574c9e368e124258e08ab95d table=testCompactionWithHFileLink 2023-03-14 14:55:07,707 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 1628452bcbc044978e89d0017623b719 of snapshot=snaptb-1678805692027 to region=46b57114435577599b693b836e0ad8d2 table=testCompactionWithHFileLink 2023-03-14 14:55:07,709 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 6c1df25b2a324da6a91f047c43539cd5 of snapshot=snaptb-1678805692027 to region=541dfbe822716da662f3a573a64aa05f table=testCompactionWithHFileLink 2023-03-14 14:55:07,709 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink e417dad5ad4041b39481cc378b7bb1d7 of snapshot=snaptb-1678805692027 to region=d03921af574c9e368e124258e08ab95d table=testCompactionWithHFileLink 2023-03-14 14:55:07,709 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 389ec0d426554927a09b80e5c5eafe3e of snapshot=snaptb-1678805692027 to region=46b57114435577599b693b836e0ad8d2 table=testCompactionWithHFileLink 2023-03-14 14:55:07,712 INFO [PEWorker-1] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "snaptb-1678805692027" table: "testCompactionWithHFileLink" creation_time: 1678805692041 type: FLUSH version: 2 ttl: 0 2023-03-14 14:55:07,712 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,1,1678805683037.46b57114435577599b693b836e0ad8d2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1678805707712"}]},"ts":"9223372036854775807"} 2023-03-14 14:55:07,713 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,,1678805683037.541dfbe822716da662f3a573a64aa05f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1678805707712"}]},"ts":"9223372036854775807"} 2023-03-14 14:55:07,713 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,2,1678805683037.d03921af574c9e368e124258e08ab95d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1678805707712"}]},"ts":"9223372036854775807"} 2023-03-14 14:55:07,714 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 3 regions from META 2023-03-14 14:55:07,714 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 46b57114435577599b693b836e0ad8d2, NAME => 'testCompactionWithHFileLink,1,1678805683037.46b57114435577599b693b836e0ad8d2.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => 541dfbe822716da662f3a573a64aa05f, NAME => 'testCompactionWithHFileLink,,1678805683037.541dfbe822716da662f3a573a64aa05f.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => d03921af574c9e368e124258e08ab95d, NAME => 'testCompactionWithHFileLink,2,1678805683037.d03921af574c9e368e124258e08ab95d.', STARTKEY => '2', ENDKEY => ''}] 2023-03-14 14:55:07,714 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1678805683037.46b57114435577599b693b836e0ad8d2.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678805707713"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678805707713"}]},"ts":"1678805707713"} 2023-03-14 14:55:07,715 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1678805683037.541dfbe822716da662f3a573a64aa05f.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678805707713"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678805707713"}]},"ts":"1678805707713"} 2023-03-14 14:55:07,715 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1678805683037.d03921af574c9e368e124258e08ab95d.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678805707713"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678805707713"}]},"ts":"1678805707713"} 2023-03-14 14:55:07,716 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-03-14 14:55:07,716 INFO [PEWorker-1] hbase.MetaTableAccessor(1810): Overwritten 3 regions to Meta 2023-03-14 14:55:07,716 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1811): Overwritten regions: [{ENCODED => 46b57114435577599b693b836e0ad8d2, NAME => 'testCompactionWithHFileLink,1,1678805683037.46b57114435577599b693b836e0ad8d2.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => 541dfbe822716da662f3a573a64aa05f, NAME => 'testCompactionWithHFileLink,,1678805683037.541dfbe822716da662f3a573a64aa05f.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => d03921af574c9e368e124258e08ab95d, NAME => 'testCompactionWithHFileLink,2,1678805683037.d03921af574c9e368e124258e08ab95d.', STARTKEY => '2', ENDKEY => ''}] 2023-03-14 14:55:07,717 INFO [PEWorker-1] procedure.RestoreSnapshotProcedure(447): Restore snapshot={ ss=snaptb-1678805692027 table=testCompactionWithHFileLink type=FLUSH ttl=0 } on table=testCompactionWithHFileLink completed! 2023-03-14 14:55:07,719 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1678805692027" table: "testCompactionWithHFileLink" creation_time: 1678805692041 type: FLUSH version: 2 ttl: 0 ) in 537 msec 2023-03-14 14:55:07,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-03-14 14:55:07,796 INFO [Listener at localhost.localdomain/44261] client.HBaseAdmin$TableFuture(3541): Operation: MODIFY, Table Name: default:testCompactionWithHFileLink, procId: 96 completed 2023-03-14 14:55:07,796 INFO [Listener at localhost.localdomain/44261] client.HBaseAdmin(2618): Deleting restore-failsafe snapshot: hbase-failsafe-snaptb-1678805692027-1678805705024 2023-03-14 14:55:07,800 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(748): Client=jenkins//148.251.75.209 delete name: "hbase-failsafe-snaptb-1678805692027-1678805705024" 2023-03-14 14:55:07,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] snapshot.SnapshotManager(333): Deleting snapshot: hbase-failsafe-snaptb-1678805692027-1678805705024 2023-03-14 14:55:07,804 INFO [Listener at localhost.localdomain/44261] client.HBaseAdmin$14(830): Started enable of testCompactionWithHFileLink 2023-03-14 14:55:07,807 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.HMaster$10(2385): Client=jenkins//148.251.75.209 enable testCompactionWithHFileLink 2023-03-14 14:55:07,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE:ENABLE_TABLE_PREPARE; EnableTableProcedure table=testCompactionWithHFileLink 2023-03-14 14:55:07,816 INFO [PEWorker-3] procedure.EnableTableProcedure(296): Attempting to enable the table testCompactionWithHFileLink 2023-03-14 14:55:07,816 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678805707816"}]},"ts":"1678805707816"} 2023-03-14 14:55:07,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-03-14 14:55:07,817 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-03-14 14:55:07,819 DEBUG [PEWorker-3] procedure.EnableTableProcedure(107): No change in number of region replicas (configuredReplicaCount=1); assigning. 2023-03-14 14:55:07,819 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=541dfbe822716da662f3a573a64aa05f, ASSIGN}, {pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=46b57114435577599b693b836e0ad8d2, ASSIGN}, {pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=d03921af574c9e368e124258e08ab95d, ASSIGN}] 2023-03-14 14:55:07,820 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=541dfbe822716da662f3a573a64aa05f, ASSIGN 2023-03-14 14:55:07,820 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=46b57114435577599b693b836e0ad8d2, ASSIGN 2023-03-14 14:55:07,820 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=d03921af574c9e368e124258e08ab95d, ASSIGN 2023-03-14 14:55:07,821 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=541dfbe822716da662f3a573a64aa05f, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-03-14 14:55:07,821 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=d03921af574c9e368e124258e08ab95d, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-03-14 14:55:07,821 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=46b57114435577599b693b836e0ad8d2, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-03-14 14:55:07,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-03-14 14:55:07,973 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=d03921af574c9e368e124258e08ab95d, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:07,973 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=541dfbe822716da662f3a573a64aa05f, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:07,973 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1678805683037.d03921af574c9e368e124258e08ab95d.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678805707973"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1678805707973"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678805707973"}]},"ts":"1678805707973"} 2023-03-14 14:55:07,973 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1678805683037.541dfbe822716da662f3a573a64aa05f.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678805707973"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1678805707973"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678805707973"}]},"ts":"1678805707973"} 2023-03-14 14:55:07,973 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=46b57114435577599b693b836e0ad8d2, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:07,973 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1678805683037.46b57114435577599b693b836e0ad8d2.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678805707973"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1678805707973"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678805707973"}]},"ts":"1678805707973"} 2023-03-14 14:55:07,975 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=101, ppid=100, state=RUNNABLE; OpenRegionProcedure d03921af574c9e368e124258e08ab95d, server=jenkins-hbase20.apache.org,41317,1678805580877}] 2023-03-14 14:55:07,976 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=98, state=RUNNABLE; OpenRegionProcedure 541dfbe822716da662f3a573a64aa05f, server=jenkins-hbase20.apache.org,41317,1678805580877}] 2023-03-14 14:55:07,977 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=99, state=RUNNABLE; OpenRegionProcedure 46b57114435577599b693b836e0ad8d2, server=jenkins-hbase20.apache.org,41317,1678805580877}] 2023-03-14 14:55:08,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-03-14 14:55:08,132 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,2,1678805683037.d03921af574c9e368e124258e08ab95d. 2023-03-14 14:55:08,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d03921af574c9e368e124258e08ab95d, NAME => 'testCompactionWithHFileLink,2,1678805683037.d03921af574c9e368e124258e08ab95d.', STARTKEY => '2', ENDKEY => ''} 2023-03-14 14:55:08,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink d03921af574c9e368e124258e08ab95d 2023-03-14 14:55:08,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1678805683037.d03921af574c9e368e124258e08ab95d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 14:55:08,134 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for d03921af574c9e368e124258e08ab95d 2023-03-14 14:55:08,134 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for d03921af574c9e368e124258e08ab95d 2023-03-14 14:55:08,136 INFO [StoreOpener-d03921af574c9e368e124258e08ab95d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region d03921af574c9e368e124258e08ab95d 2023-03-14 14:55:08,138 DEBUG [StoreOpener-d03921af574c9e368e124258e08ab95d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family1 2023-03-14 14:55:08,138 DEBUG [StoreOpener-d03921af574c9e368e124258e08ab95d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family1 2023-03-14 14:55:08,139 INFO [StoreOpener-d03921af574c9e368e124258e08ab95d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d03921af574c9e368e124258e08ab95d columnFamilyName family1 2023-03-14 14:55:08,158 DEBUG [StoreOpener-d03921af574c9e368e124258e08ab95d-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family1/testCompactionWithHFileLink=d03921af574c9e368e124258e08ab95d-0d78103959d84c55bf5fd402a71523ff 2023-03-14 14:55:08,165 DEBUG [StoreOpener-d03921af574c9e368e124258e08ab95d-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family1/testCompactionWithHFileLink=d03921af574c9e368e124258e08ab95d-25a93ba0de464a7680c159909c51660b 2023-03-14 14:55:08,171 DEBUG [StoreOpener-d03921af574c9e368e124258e08ab95d-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family1/testCompactionWithHFileLink=d03921af574c9e368e124258e08ab95d-7bedf33c34414f65b99ef964dca782ad 2023-03-14 14:55:08,176 DEBUG [StoreOpener-d03921af574c9e368e124258e08ab95d-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family1/testCompactionWithHFileLink=d03921af574c9e368e124258e08ab95d-ef4e5b48bebf48c4a6d53a9834e30bb5 2023-03-14 14:55:08,177 INFO [StoreOpener-d03921af574c9e368e124258e08ab95d-1] regionserver.HStore(310): Store=d03921af574c9e368e124258e08ab95d/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 14:55:08,177 INFO [StoreOpener-d03921af574c9e368e124258e08ab95d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region d03921af574c9e368e124258e08ab95d 2023-03-14 14:55:08,178 DEBUG [StoreOpener-d03921af574c9e368e124258e08ab95d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family2 2023-03-14 14:55:08,178 DEBUG [StoreOpener-d03921af574c9e368e124258e08ab95d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family2 2023-03-14 14:55:08,178 INFO [StoreOpener-d03921af574c9e368e124258e08ab95d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d03921af574c9e368e124258e08ab95d columnFamilyName family2 2023-03-14 14:55:08,187 DEBUG [StoreOpener-d03921af574c9e368e124258e08ab95d-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family2/testCompactionWithHFileLink=d03921af574c9e368e124258e08ab95d-9a13180cb0db4dbd970bf225dcab0e4c 2023-03-14 14:55:08,193 DEBUG [StoreOpener-d03921af574c9e368e124258e08ab95d-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family2/testCompactionWithHFileLink=d03921af574c9e368e124258e08ab95d-a25e279e24aa4b70919faaa31a07769a 2023-03-14 14:55:08,199 DEBUG [StoreOpener-d03921af574c9e368e124258e08ab95d-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family2/testCompactionWithHFileLink=d03921af574c9e368e124258e08ab95d-a8d3d3d688f44d5c98b54f77a810edfb 2023-03-14 14:55:08,204 DEBUG [StoreOpener-d03921af574c9e368e124258e08ab95d-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family2/testCompactionWithHFileLink=d03921af574c9e368e124258e08ab95d-e417dad5ad4041b39481cc378b7bb1d7 2023-03-14 14:55:08,205 INFO [StoreOpener-d03921af574c9e368e124258e08ab95d-1] regionserver.HStore(310): Store=d03921af574c9e368e124258e08ab95d/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 14:55:08,206 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d 2023-03-14 14:55:08,206 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d 2023-03-14 14:55:08,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-14 14:55:08,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for d03921af574c9e368e124258e08ab95d 2023-03-14 14:55:08,209 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened d03921af574c9e368e124258e08ab95d; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71879164, jitterRate=0.07108300924301147}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-14 14:55:08,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for d03921af574c9e368e124258e08ab95d: 2023-03-14 14:55:08,210 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,2,1678805683037.d03921af574c9e368e124258e08ab95d., pid=101, masterSystemTime=1678805708128 2023-03-14 14:55:08,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-14 14:55:08,211 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-03-14 14:55:08,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-14 14:55:08,211 DEBUG [RS:0;jenkins-hbase20:41317-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-03-14 14:55:08,212 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,2,1678805683037.d03921af574c9e368e124258e08ab95d. 2023-03-14 14:55:08,212 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,2,1678805683037.d03921af574c9e368e124258e08ab95d. 2023-03-14 14:55:08,212 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,1,1678805683037.46b57114435577599b693b836e0ad8d2. 2023-03-14 14:55:08,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 46b57114435577599b693b836e0ad8d2, NAME => 'testCompactionWithHFileLink,1,1678805683037.46b57114435577599b693b836e0ad8d2.', STARTKEY => '1', ENDKEY => '2'} 2023-03-14 14:55:08,213 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=d03921af574c9e368e124258e08ab95d, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:08,213 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1678805683037.d03921af574c9e368e124258e08ab95d.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678805708213"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1678805708213"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678805708213"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678805708213"}]},"ts":"1678805708213"} 2023-03-14 14:55:08,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 46b57114435577599b693b836e0ad8d2 2023-03-14 14:55:08,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1678805683037.46b57114435577599b693b836e0ad8d2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 14:55:08,213 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-03-14 14:55:08,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 46b57114435577599b693b836e0ad8d2 2023-03-14 14:55:08,213 DEBUG [RS:0;jenkins-hbase20:41317-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-03-14 14:55:08,213 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HStore(1912): d03921af574c9e368e124258e08ab95d/family1 is initiating minor compaction (all files) 2023-03-14 14:55:08,213 DEBUG [RS:0;jenkins-hbase20:41317-longCompactions-0] regionserver.HStore(1912): d03921af574c9e368e124258e08ab95d/family2 is initiating minor compaction (all files) 2023-03-14 14:55:08,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 46b57114435577599b693b836e0ad8d2 2023-03-14 14:55:08,213 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of d03921af574c9e368e124258e08ab95d/family1 in testCompactionWithHFileLink,2,1678805683037.d03921af574c9e368e124258e08ab95d. 2023-03-14 14:55:08,213 INFO [RS:0;jenkins-hbase20:41317-longCompactions-0] regionserver.HRegion(2259): Starting compaction of d03921af574c9e368e124258e08ab95d/family2 in testCompactionWithHFileLink,2,1678805683037.d03921af574c9e368e124258e08ab95d. 2023-03-14 14:55:08,213 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family1/testCompactionWithHFileLink=d03921af574c9e368e124258e08ab95d-7bedf33c34414f65b99ef964dca782ad, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family1/testCompactionWithHFileLink=d03921af574c9e368e124258e08ab95d-25a93ba0de464a7680c159909c51660b, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family1/testCompactionWithHFileLink=d03921af574c9e368e124258e08ab95d-0d78103959d84c55bf5fd402a71523ff, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family1/testCompactionWithHFileLink=d03921af574c9e368e124258e08ab95d-ef4e5b48bebf48c4a6d53a9834e30bb5] into tmpdir=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/.tmp, totalSize=21.6 K 2023-03-14 14:55:08,213 INFO [RS:0;jenkins-hbase20:41317-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family2/testCompactionWithHFileLink=d03921af574c9e368e124258e08ab95d-a8d3d3d688f44d5c98b54f77a810edfb, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family2/testCompactionWithHFileLink=d03921af574c9e368e124258e08ab95d-a25e279e24aa4b70919faaa31a07769a, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family2/testCompactionWithHFileLink=d03921af574c9e368e124258e08ab95d-9a13180cb0db4dbd970bf225dcab0e4c, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family2/testCompactionWithHFileLink=d03921af574c9e368e124258e08ab95d-e417dad5ad4041b39481cc378b7bb1d7] into tmpdir=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/.tmp, totalSize=20.4 K 2023-03-14 14:55:08,214 DEBUG [RS:0;jenkins-hbase20:41317-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=d03921af574c9e368e124258e08ab95d-a8d3d3d688f44d5c98b54f77a810edfb, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678805685169 2023-03-14 14:55:08,214 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=d03921af574c9e368e124258e08ab95d-7bedf33c34414f65b99ef964dca782ad, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678805685169 2023-03-14 14:55:08,214 INFO [StoreOpener-46b57114435577599b693b836e0ad8d2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 46b57114435577599b693b836e0ad8d2 2023-03-14 14:55:08,215 DEBUG [RS:0;jenkins-hbase20:41317-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=d03921af574c9e368e124258e08ab95d-a25e279e24aa4b70919faaa31a07769a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678805686982 2023-03-14 14:55:08,215 DEBUG [StoreOpener-46b57114435577599b693b836e0ad8d2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1 2023-03-14 14:55:08,215 DEBUG [StoreOpener-46b57114435577599b693b836e0ad8d2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1 2023-03-14 14:55:08,215 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=d03921af574c9e368e124258e08ab95d-25a93ba0de464a7680c159909c51660b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678805686982 2023-03-14 14:55:08,215 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=100 2023-03-14 14:55:08,215 INFO [StoreOpener-46b57114435577599b693b836e0ad8d2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 46b57114435577599b693b836e0ad8d2 columnFamilyName family1 2023-03-14 14:55:08,216 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=100, state=SUCCESS; OpenRegionProcedure d03921af574c9e368e124258e08ab95d, server=jenkins-hbase20.apache.org,41317,1678805580877 in 239 msec 2023-03-14 14:55:08,216 DEBUG [RS:0;jenkins-hbase20:41317-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=d03921af574c9e368e124258e08ab95d-9a13180cb0db4dbd970bf225dcab0e4c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678805688805 2023-03-14 14:55:08,216 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=d03921af574c9e368e124258e08ab95d-0d78103959d84c55bf5fd402a71523ff, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678805688805 2023-03-14 14:55:08,216 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=d03921af574c9e368e124258e08ab95d, ASSIGN in 397 msec 2023-03-14 14:55:08,217 DEBUG [RS:0;jenkins-hbase20:41317-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=d03921af574c9e368e124258e08ab95d-e417dad5ad4041b39481cc378b7bb1d7, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678805690218 2023-03-14 14:55:08,217 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=d03921af574c9e368e124258e08ab95d-ef4e5b48bebf48c4a6d53a9834e30bb5, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678805690218 2023-03-14 14:55:08,230 DEBUG [StoreOpener-46b57114435577599b693b836e0ad8d2-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1/testCompactionWithHFileLink=46b57114435577599b693b836e0ad8d2-a6062f3df98748bdabc1471e8d8f1031 2023-03-14 14:55:08,239 DEBUG [StoreOpener-46b57114435577599b693b836e0ad8d2-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1/testCompactionWithHFileLink=46b57114435577599b693b836e0ad8d2-b19c3c6a9bf5422989ad34b1bd3dd634 2023-03-14 14:55:08,245 DEBUG [StoreOpener-46b57114435577599b693b836e0ad8d2-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1/testCompactionWithHFileLink=46b57114435577599b693b836e0ad8d2-b3edf5484f304570ace5edaeaed6a1f1 2023-03-14 14:55:08,246 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] throttle.PressureAwareThroughputController(145): d03921af574c9e368e124258e08ab95d#family1#compaction#114 average throughput is 1.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 57.69 MB/second 2023-03-14 14:55:08,246 INFO [RS:0;jenkins-hbase20:41317-longCompactions-0] throttle.PressureAwareThroughputController(145): d03921af574c9e368e124258e08ab95d#family2#compaction#115 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 57.69 MB/second 2023-03-14 14:55:08,252 DEBUG [StoreOpener-46b57114435577599b693b836e0ad8d2-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1/testCompactionWithHFileLink=46b57114435577599b693b836e0ad8d2-c9bf5b936237414485b321f354149a3f 2023-03-14 14:55:08,252 INFO [StoreOpener-46b57114435577599b693b836e0ad8d2-1] regionserver.HStore(310): Store=46b57114435577599b693b836e0ad8d2/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 14:55:08,252 INFO [StoreOpener-46b57114435577599b693b836e0ad8d2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 46b57114435577599b693b836e0ad8d2 2023-03-14 14:55:08,253 DEBUG [StoreOpener-46b57114435577599b693b836e0ad8d2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family2 2023-03-14 14:55:08,253 DEBUG [StoreOpener-46b57114435577599b693b836e0ad8d2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family2 2023-03-14 14:55:08,253 INFO [StoreOpener-46b57114435577599b693b836e0ad8d2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 46b57114435577599b693b836e0ad8d2 columnFamilyName family2 2023-03-14 14:55:08,261 DEBUG [StoreOpener-46b57114435577599b693b836e0ad8d2-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family2/testCompactionWithHFileLink=46b57114435577599b693b836e0ad8d2-1628452bcbc044978e89d0017623b719 2023-03-14 14:55:08,265 DEBUG [StoreOpener-46b57114435577599b693b836e0ad8d2-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family2/testCompactionWithHFileLink=46b57114435577599b693b836e0ad8d2-389ec0d426554927a09b80e5c5eafe3e 2023-03-14 14:55:08,272 DEBUG [StoreOpener-46b57114435577599b693b836e0ad8d2-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family2/testCompactionWithHFileLink=46b57114435577599b693b836e0ad8d2-b01622885e094dce84b6378c5e6e9a6f 2023-03-14 14:55:08,278 DEBUG [StoreOpener-46b57114435577599b693b836e0ad8d2-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family2/testCompactionWithHFileLink=46b57114435577599b693b836e0ad8d2-f50ca180804e42159fa65ddb96403962 2023-03-14 14:55:08,278 INFO [StoreOpener-46b57114435577599b693b836e0ad8d2-1] regionserver.HStore(310): Store=46b57114435577599b693b836e0ad8d2/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 14:55:08,279 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2 2023-03-14 14:55:08,280 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2 2023-03-14 14:55:08,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-14 14:55:08,282 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 46b57114435577599b693b836e0ad8d2 2023-03-14 14:55:08,283 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 46b57114435577599b693b836e0ad8d2; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64380025, jitterRate=-0.040662869811058044}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-14 14:55:08,283 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 46b57114435577599b693b836e0ad8d2: 2023-03-14 14:55:08,284 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,1,1678805683037.46b57114435577599b693b836e0ad8d2., pid=103, masterSystemTime=1678805708128 2023-03-14 14:55:08,284 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-03-14 14:55:08,284 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-03-14 14:55:08,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,1,1678805683037.46b57114435577599b693b836e0ad8d2. 2023-03-14 14:55:08,285 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,1,1678805683037.46b57114435577599b693b836e0ad8d2. 2023-03-14 14:55:08,285 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,,1678805683037.541dfbe822716da662f3a573a64aa05f. 2023-03-14 14:55:08,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 541dfbe822716da662f3a573a64aa05f, NAME => 'testCompactionWithHFileLink,,1678805683037.541dfbe822716da662f3a573a64aa05f.', STARTKEY => '', ENDKEY => '1'} 2023-03-14 14:55:08,285 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=46b57114435577599b693b836e0ad8d2, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:08,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 541dfbe822716da662f3a573a64aa05f 2023-03-14 14:55:08,285 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1678805683037.46b57114435577599b693b836e0ad8d2.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678805708285"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1678805708285"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678805708285"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678805708285"}]},"ts":"1678805708285"} 2023-03-14 14:55:08,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1678805683037.541dfbe822716da662f3a573a64aa05f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 14:55:08,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 541dfbe822716da662f3a573a64aa05f 2023-03-14 14:55:08,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 541dfbe822716da662f3a573a64aa05f 2023-03-14 14:55:08,287 INFO [StoreOpener-541dfbe822716da662f3a573a64aa05f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 541dfbe822716da662f3a573a64aa05f 2023-03-14 14:55:08,287 DEBUG [StoreOpener-541dfbe822716da662f3a573a64aa05f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1 2023-03-14 14:55:08,287 DEBUG [StoreOpener-541dfbe822716da662f3a573a64aa05f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1 2023-03-14 14:55:08,288 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=99 2023-03-14 14:55:08,288 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=99, state=SUCCESS; OpenRegionProcedure 46b57114435577599b693b836e0ad8d2, server=jenkins-hbase20.apache.org,41317,1678805580877 in 309 msec 2023-03-14 14:55:08,288 INFO [StoreOpener-541dfbe822716da662f3a573a64aa05f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 541dfbe822716da662f3a573a64aa05f columnFamilyName family1 2023-03-14 14:55:08,288 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=99, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=46b57114435577599b693b836e0ad8d2, ASSIGN in 469 msec 2023-03-14 14:55:08,294 DEBUG [StoreOpener-541dfbe822716da662f3a573a64aa05f-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1/testCompactionWithHFileLink=541dfbe822716da662f3a573a64aa05f-1b5ac87360aa4bb191cc4449750a7907 2023-03-14 14:55:08,298 DEBUG [StoreOpener-541dfbe822716da662f3a573a64aa05f-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1/testCompactionWithHFileLink=541dfbe822716da662f3a573a64aa05f-3d7816c125124489b2759873bb2274f5 2023-03-14 14:55:08,303 DEBUG [StoreOpener-541dfbe822716da662f3a573a64aa05f-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1/testCompactionWithHFileLink=541dfbe822716da662f3a573a64aa05f-591c70d95e90448b9e60702762d6fe7b 2023-03-14 14:55:08,309 DEBUG [StoreOpener-541dfbe822716da662f3a573a64aa05f-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1/testCompactionWithHFileLink=541dfbe822716da662f3a573a64aa05f-70e0f28062314487bee0b6ed2ce10d0b 2023-03-14 14:55:08,309 INFO [StoreOpener-541dfbe822716da662f3a573a64aa05f-1] regionserver.HStore(310): Store=541dfbe822716da662f3a573a64aa05f/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 14:55:08,310 INFO [StoreOpener-541dfbe822716da662f3a573a64aa05f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 541dfbe822716da662f3a573a64aa05f 2023-03-14 14:55:08,310 DEBUG [StoreOpener-541dfbe822716da662f3a573a64aa05f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family2 2023-03-14 14:55:08,310 DEBUG [StoreOpener-541dfbe822716da662f3a573a64aa05f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family2 2023-03-14 14:55:08,311 INFO [StoreOpener-541dfbe822716da662f3a573a64aa05f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 541dfbe822716da662f3a573a64aa05f columnFamilyName family2 2023-03-14 14:55:08,317 DEBUG [StoreOpener-541dfbe822716da662f3a573a64aa05f-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family2/testCompactionWithHFileLink=541dfbe822716da662f3a573a64aa05f-04bf20de187e447d8cd4c89e4ba37610 2023-03-14 14:55:08,324 DEBUG [StoreOpener-541dfbe822716da662f3a573a64aa05f-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family2/testCompactionWithHFileLink=541dfbe822716da662f3a573a64aa05f-3a131025d2344260a03875522668b04a 2023-03-14 14:55:08,337 DEBUG [StoreOpener-541dfbe822716da662f3a573a64aa05f-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family2/testCompactionWithHFileLink=541dfbe822716da662f3a573a64aa05f-55badc960cc24ee5ad7320c72ae33a8f 2023-03-14 14:55:08,344 DEBUG [StoreOpener-541dfbe822716da662f3a573a64aa05f-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family2/testCompactionWithHFileLink=541dfbe822716da662f3a573a64aa05f-6c1df25b2a324da6a91f047c43539cd5 2023-03-14 14:55:08,344 INFO [StoreOpener-541dfbe822716da662f3a573a64aa05f-1] regionserver.HStore(310): Store=541dfbe822716da662f3a573a64aa05f/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 14:55:08,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f 2023-03-14 14:55:08,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f 2023-03-14 14:55:08,348 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-14 14:55:08,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 541dfbe822716da662f3a573a64aa05f 2023-03-14 14:55:08,350 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 541dfbe822716da662f3a573a64aa05f; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70778297, jitterRate=0.05467881262302399}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-14 14:55:08,350 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 541dfbe822716da662f3a573a64aa05f: 2023-03-14 14:55:08,351 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,,1678805683037.541dfbe822716da662f3a573a64aa05f., pid=102, masterSystemTime=1678805708128 2023-03-14 14:55:08,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-03-14 14:55:08,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-03-14 14:55:08,352 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,,1678805683037.541dfbe822716da662f3a573a64aa05f. 2023-03-14 14:55:08,352 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,,1678805683037.541dfbe822716da662f3a573a64aa05f. 2023-03-14 14:55:08,353 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=541dfbe822716da662f3a573a64aa05f, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:08,353 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1678805683037.541dfbe822716da662f3a573a64aa05f.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1678805708353"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1678805708353"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678805708353"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678805708353"}]},"ts":"1678805708353"} 2023-03-14 14:55:08,356 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=98 2023-03-14 14:55:08,356 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=98, state=SUCCESS; OpenRegionProcedure 541dfbe822716da662f3a573a64aa05f, server=jenkins-hbase20.apache.org,41317,1678805580877 in 378 msec 2023-03-14 14:55:08,357 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=98, resume processing ppid=97 2023-03-14 14:55:08,357 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=98, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=541dfbe822716da662f3a573a64aa05f, ASSIGN in 537 msec 2023-03-14 14:55:08,358 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678805708358"}]},"ts":"1678805708358"} 2023-03-14 14:55:08,359 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-03-14 14:55:08,360 INFO [PEWorker-3] procedure.EnableTableProcedure(310): Table 'testCompactionWithHFileLink' was successfully enabled. 2023-03-14 14:55:08,362 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; EnableTableProcedure table=testCompactionWithHFileLink in 552 msec 2023-03-14 14:55:08,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-03-14 14:55:08,421 INFO [Listener at localhost.localdomain/44261] client.HBaseAdmin$TableFuture(3541): Operation: ENABLE, Table Name: default:testCompactionWithHFileLink, procId: 97 completed 2023-03-14 14:55:08,436 DEBUG [Listener at localhost.localdomain/44261] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-14 14:55:08,444 DEBUG [Listener at localhost.localdomain/44261] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-14 14:55:08,451 DEBUG [Listener at localhost.localdomain/44261] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-14 14:55:08,452 DEBUG [Listener at localhost.localdomain/44261] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-14 14:55:08,457 INFO [Listener at localhost.localdomain/44261] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-03-14 14:55:08,470 INFO [Listener at localhost.localdomain/44261] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-03-14 14:55:08,470 INFO [Listener at localhost.localdomain/44261] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testCompactionWithHFileLink' column='family1' 2023-03-14 14:55:08,470 DEBUG [Listener at localhost.localdomain/44261] zookeeper.ReadOnlyZKClient(139): Connect 0x3b4b040e to 127.0.0.1:50211 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-14 14:55:08,474 DEBUG [Listener at localhost.localdomain/44261] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@55eb4c1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-14 14:55:08,474 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230314 for table='testCompactionWithHFileLink' and column='family1' 2023-03-14 14:55:08,474 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230314 for table='testCompactionWithHFileLink' and column='family1' 2023-03-14 14:55:08,474 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230314 for table='testCompactionWithHFileLink' and column='family1' 2023-03-14 14:55:08,958 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230314d9905b1cd13d40f888295071f38c4d0e to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230314d9905b1cd13d40f888295071f38c4d0e 2023-03-14 14:55:08,960 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230314 table='testCompactionWithHFileLink' column='family1' 2023-03-14 14:55:08,971 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-14 14:55:08,974 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:37094, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-14 14:55:08,980 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-14 14:55:08,983 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:53420, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-14 14:55:08,992 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230314/family1/d62d62baca9c4a2fa0643a51d9ed1d60 first=Optional[0\x00\x00\x00\x00] last=Optional[0\x00\x00\x00\x07] 2023-03-14 14:55:08,993 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,,1678805683037.541dfbe822716da662f3a573a64aa05f., hostname=jenkins-hbase20.apache.org,41317,1678805580877, seqNum=32 for row with hfile group [{family1,hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230314/family1/d62d62baca9c4a2fa0643a51d9ed1d60}] 2023-03-14 14:55:08,998 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230314/family1/d62d62baca9c4a2fa0643a51d9ed1d60 for inclusion in 541dfbe822716da662f3a573a64aa05f/family1 2023-03-14 14:55:09,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x00 last=0\x00\x00\x00\x07 2023-03-14 14:55:09,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HStore(777): Region bounds: first= last=1 2023-03-14 14:55:09,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HRegion(2446): Flush status journal for 541dfbe822716da662f3a573a64aa05f: 2023-03-14 14:55:09,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230314/family1/d62d62baca9c4a2fa0643a51d9ed1d60 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testCompactionWithHFileLink__61pphhpq3qpu6j1qghog9jfausob2psk8547ll3k64ipsae6ktgj6bo310tah4tf/family1/d62d62baca9c4a2fa0643a51d9ed1d60 2023-03-14 14:55:09,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testCompactionWithHFileLink__61pphhpq3qpu6j1qghog9jfausob2psk8547ll3k64ipsae6ktgj6bo310tah4tf/family1/d62d62baca9c4a2fa0643a51d9ed1d60 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1/bc1359b033654c9684705786507eb1c8_SeqId_34_ 2023-03-14 14:55:09,007 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testCompactionWithHFileLink__61pphhpq3qpu6j1qghog9jfausob2psk8547ll3k64ipsae6ktgj6bo310tah4tf/family1/d62d62baca9c4a2fa0643a51d9ed1d60 into 541dfbe822716da662f3a573a64aa05f/family1 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1/bc1359b033654c9684705786507eb1c8_SeqId_34_ - updating store file list. 2023-03-14 14:55:09,012 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1/bc1359b033654c9684705786507eb1c8_SeqId_34_ into 541dfbe822716da662f3a573a64aa05f/family1 2023-03-14 14:55:09,012 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testCompactionWithHFileLink__61pphhpq3qpu6j1qghog9jfausob2psk8547ll3k64ipsae6ktgj6bo310tah4tf/family1/d62d62baca9c4a2fa0643a51d9ed1d60 into 541dfbe822716da662f3a573a64aa05f/family1 (new location: hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1/bc1359b033654c9684705786507eb1c8_SeqId_34_) 2023-03-14 14:55:09,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testCompactionWithHFileLink__61pphhpq3qpu6j1qghog9jfausob2psk8547ll3k64ipsae6ktgj6bo310tah4tf/family1/d62d62baca9c4a2fa0643a51d9ed1d60 2023-03-14 14:55:09,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-14 14:55:09,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-03-14 14:55:09,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HStore(1912): 541dfbe822716da662f3a573a64aa05f/family1 is initiating minor compaction (all files) 2023-03-14 14:55:09,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@1b1cb0b3; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-03-14 14:55:09,019 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230314 table='testCompactionWithHFileLink' column='family1' 2023-03-14 14:55:09,020 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 14:55:09,023 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023031409ce4a6ddfb84b438695750db282e007 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023031409ce4a6ddfb84b438695750db282e007 2023-03-14 14:55:09,024 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023031454adfebd63414c198bff0e938bfc1e87 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023031454adfebd63414c198bff0e938bfc1e87 2023-03-14 14:55:09,025 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202303149c8e68c75520486e8f847c138d0f55ce to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202303149c8e68c75520486e8f847c138d0f55ce 2023-03-14 14:55:09,026 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230314d71ba2d46f4e4de689ca125a16b89c45 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230314d71ba2d46f4e4de689ca125a16b89c45 2023-03-14 14:55:09,026 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-03-14 14:55:09,026 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230314' 2023-03-14 14:55:09,026 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230314 for table='testCompactionWithHFileLink' and column='family1' 2023-03-14 14:55:09,360 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303144b3c9a6011704df39de86856b56be713 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202303144b3c9a6011704df39de86856b56be713 2023-03-14 14:55:09,361 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230314 table='testCompactionWithHFileLink' column='family1' 2023-03-14 14:55:09,362 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023031487cca9abb70b4a3b810852547cccd0c1 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023031487cca9abb70b4a3b810852547cccd0c1 2023-03-14 14:55:09,363 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230314 table='testCompactionWithHFileLink' column='family1' 2023-03-14 14:55:09,392 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230314/family1/17b492fff6184865bfe9f0b89f1f7fcc first=Optional[2\x00\x00\x00\x00] last=Optional[2\x00\x00\x00\x07] 2023-03-14 14:55:09,392 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230314/family1/73b20aae9b4b4c0082d2e9d3af0a8ba6 first=Optional[1\x00\x00\x00\x00] last=Optional[1\x00\x00\x00\x07] 2023-03-14 14:55:09,393 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,1,1678805683037.46b57114435577599b693b836e0ad8d2., hostname=jenkins-hbase20.apache.org,41317,1678805580877, seqNum=32 for row 1 with hfile group [{family1,hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230314/family1/73b20aae9b4b4c0082d2e9d3af0a8ba6}] 2023-03-14 14:55:09,393 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,2,1678805683037.d03921af574c9e368e124258e08ab95d., hostname=jenkins-hbase20.apache.org,41317,1678805580877, seqNum=32 for row 2 with hfile group [{family1,hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230314/family1/17b492fff6184865bfe9f0b89f1f7fcc}] 2023-03-14 14:55:09,396 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230314/family1/73b20aae9b4b4c0082d2e9d3af0a8ba6 for inclusion in 46b57114435577599b693b836e0ad8d2/family1 2023-03-14 14:55:09,396 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230314/family1/17b492fff6184865bfe9f0b89f1f7fcc for inclusion in d03921af574c9e368e124258e08ab95d/family1 2023-03-14 14:55:09,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x00 last=2\x00\x00\x00\x07 2023-03-14 14:55:09,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x00 last=1\x00\x00\x00\x07 2023-03-14 14:55:09,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(777): Region bounds: first=1 last=2 2023-03-14 14:55:09,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HStore(777): Region bounds: first=2 last= 2023-03-14 14:55:09,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HRegion(2446): Flush status journal for d03921af574c9e368e124258e08ab95d: 2023-03-14 14:55:09,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HRegion(2446): Flush status journal for 46b57114435577599b693b836e0ad8d2: 2023-03-14 14:55:09,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230314/family1/73b20aae9b4b4c0082d2e9d3af0a8ba6 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testCompactionWithHFileLink__9jrihp8k6potigvnu96f0orb5akpa51lju41rh0e65oug606hpoamrjq8ao0fuc/family1/73b20aae9b4b4c0082d2e9d3af0a8ba6 2023-03-14 14:55:09,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230314/family1/17b492fff6184865bfe9f0b89f1f7fcc to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testCompactionWithHFileLink__9nroo4di636gqvhgimld4vl7mv5siilggngc9a3ndbmev74cm27a2bb65eb3iru9/family1/17b492fff6184865bfe9f0b89f1f7fcc 2023-03-14 14:55:09,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testCompactionWithHFileLink__9jrihp8k6potigvnu96f0orb5akpa51lju41rh0e65oug606hpoamrjq8ao0fuc/family1/73b20aae9b4b4c0082d2e9d3af0a8ba6 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1/ad4530e0e2ba474bade2d93977f00a65_SeqId_34_ 2023-03-14 14:55:09,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testCompactionWithHFileLink__9nroo4di636gqvhgimld4vl7mv5siilggngc9a3ndbmev74cm27a2bb65eb3iru9/family1/17b492fff6184865bfe9f0b89f1f7fcc as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family1/2cce5e17a467405aabe5aa2031d937db_SeqId_34_ 2023-03-14 14:55:09,402 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testCompactionWithHFileLink__9jrihp8k6potigvnu96f0orb5akpa51lju41rh0e65oug606hpoamrjq8ao0fuc/family1/73b20aae9b4b4c0082d2e9d3af0a8ba6 into 46b57114435577599b693b836e0ad8d2/family1 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1/ad4530e0e2ba474bade2d93977f00a65_SeqId_34_ - updating store file list. 2023-03-14 14:55:09,402 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testCompactionWithHFileLink__9nroo4di636gqvhgimld4vl7mv5siilggngc9a3ndbmev74cm27a2bb65eb3iru9/family1/17b492fff6184865bfe9f0b89f1f7fcc into d03921af574c9e368e124258e08ab95d/family1 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family1/2cce5e17a467405aabe5aa2031d937db_SeqId_34_ - updating store file list. 2023-03-14 14:55:09,405 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family1/2cce5e17a467405aabe5aa2031d937db_SeqId_34_ into d03921af574c9e368e124258e08ab95d/family1 2023-03-14 14:55:09,405 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1/ad4530e0e2ba474bade2d93977f00a65_SeqId_34_ into 46b57114435577599b693b836e0ad8d2/family1 2023-03-14 14:55:09,405 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testCompactionWithHFileLink__9nroo4di636gqvhgimld4vl7mv5siilggngc9a3ndbmev74cm27a2bb65eb3iru9/family1/17b492fff6184865bfe9f0b89f1f7fcc into d03921af574c9e368e124258e08ab95d/family1 (new location: hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family1/2cce5e17a467405aabe5aa2031d937db_SeqId_34_) 2023-03-14 14:55:09,405 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testCompactionWithHFileLink__9jrihp8k6potigvnu96f0orb5akpa51lju41rh0e65oug606hpoamrjq8ao0fuc/family1/73b20aae9b4b4c0082d2e9d3af0a8ba6 into 46b57114435577599b693b836e0ad8d2/family1 (new location: hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1/ad4530e0e2ba474bade2d93977f00a65_SeqId_34_) 2023-03-14 14:55:09,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testCompactionWithHFileLink__9jrihp8k6potigvnu96f0orb5akpa51lju41rh0e65oug606hpoamrjq8ao0fuc/family1/73b20aae9b4b4c0082d2e9d3af0a8ba6 2023-03-14 14:55:09,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testCompactionWithHFileLink__9nroo4di636gqvhgimld4vl7mv5siilggngc9a3ndbmev74cm27a2bb65eb3iru9/family1/17b492fff6184865bfe9f0b89f1f7fcc 2023-03-14 14:55:09,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-14 14:55:09,407 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230314 table='testCompactionWithHFileLink' column='family1' 2023-03-14 14:55:09,408 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 14:55:09,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-03-14 14:55:09,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(1912): 46b57114435577599b693b836e0ad8d2/family1 is initiating minor compaction (all files) 2023-03-14 14:55:09,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@53bd159a; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=6), splitQueue=0 2023-03-14 14:55:09,409 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230314166d9758f1064d329f3c4b65a7ba8729 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230314166d9758f1064d329f3c4b65a7ba8729 2023-03-14 14:55:09,410 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230314 table='testCompactionWithHFileLink' column='family1' 2023-03-14 14:55:09,410 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202303145ee28b82bdc245389b68cc7d9e252743 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202303145ee28b82bdc245389b68cc7d9e252743 2023-03-14 14:55:09,410 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 14:55:09,411 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230314976e5048cf584ab8bdad3c00af0cd325 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230314976e5048cf584ab8bdad3c00af0cd325 2023-03-14 14:55:09,411 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202303140793053a07d1492b94e2f50baefaf1e0 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202303140793053a07d1492b94e2f50baefaf1e0 2023-03-14 14:55:09,412 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230314b353e02f869a49458bca945e03232f09 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230314b353e02f869a49458bca945e03232f09 2023-03-14 14:55:09,412 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-03-14 14:55:09,412 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230314' 2023-03-14 14:55:09,412 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230314 for table='testCompactionWithHFileLink' and column='family1' 2023-03-14 14:55:09,412 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202303144f70f82c217d488083d264a4438a183c to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202303144f70f82c217d488083d264a4438a183c 2023-03-14 14:55:09,413 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230314a5917ff88234474e908ccfc6684a0e94 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230314a5917ff88234474e908ccfc6684a0e94 2023-03-14 14:55:09,414 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230314c26db956b7364b62b4786bde77df793b to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230314c26db956b7364b62b4786bde77df793b 2023-03-14 14:55:09,414 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-03-14 14:55:09,414 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230314' 2023-03-14 14:55:09,414 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230314 for table='testCompactionWithHFileLink' and column='family1' 2023-03-14 14:55:09,414 INFO [Listener at localhost.localdomain/44261] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-03-14 14:55:09,417 DEBUG [Listener at localhost.localdomain/44261] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-14 14:55:09,419 DEBUG [Listener at localhost.localdomain/44261] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-14 14:55:09,422 DEBUG [Listener at localhost.localdomain/44261] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-14 14:55:09,423 DEBUG [Listener at localhost.localdomain/44261] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-14 14:55:09,429 DEBUG [Listener at localhost.localdomain/44261] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-14 14:55:09,430 DEBUG [Listener at localhost.localdomain/44261] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-14 14:55:09,447 INFO [Listener at localhost.localdomain/44261] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=285 (was 236) - Thread LEAK? -, OpenFileDescriptor=761 (was 597) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=124 (was 161), ProcessCount=179 (was 170) - ProcessCount LEAK? -, AvailableMemoryMB=12240 (was 12357) 2023-03-14 14:55:09,459 INFO [Listener at localhost.localdomain/44261] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompaction Thread=285, OpenFileDescriptor=761, MaxFileDescriptor=60000, SystemLoadAverage=124, ProcessCount=179, AvailableMemoryMB=12240 2023-03-14 14:55:09,463 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.HMaster$15(3014): Client=jenkins//148.251.75.209 creating {NAME => 'ns'} 2023-03-14 14:55:09,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=ns 2023-03-14 14:55:09,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=104 2023-03-14 14:55:09,470 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-03-14 14:55:09,470 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/.tmp/family1/382f48a53f8d40e193d741a06b522ae0 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family1/382f48a53f8d40e193d741a06b522ae0 2023-03-14 14:55:09,470 DEBUG [RS:0;jenkins-hbase20:41317-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/.tmp/family2/746b407b0397490c9a16592767bfb930 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family2/746b407b0397490c9a16592767bfb930 2023-03-14 14:55:09,472 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; CreateNamespaceProcedure, namespace=ns in 7 msec 2023-03-14 14:55:09,474 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in d03921af574c9e368e124258e08ab95d/family1 of d03921af574c9e368e124258e08ab95d into 382f48a53f8d40e193d741a06b522ae0(size=7.6 K), total size for store is 14.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-14 14:55:09,474 INFO [RS:0;jenkins-hbase20:41317-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in d03921af574c9e368e124258e08ab95d/family2 of d03921af574c9e368e124258e08ab95d into 746b407b0397490c9a16592767bfb930(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-14 14:55:09,474 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for d03921af574c9e368e124258e08ab95d: 2023-03-14 14:55:09,474 DEBUG [RS:0;jenkins-hbase20:41317-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for d03921af574c9e368e124258e08ab95d: 2023-03-14 14:55:09,474 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1678805683037.d03921af574c9e368e124258e08ab95d., storeName=d03921af574c9e368e124258e08ab95d/family1, priority=12, startTime=1678805708210; duration=1sec 2023-03-14 14:55:09,474 INFO [RS:0;jenkins-hbase20:41317-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1678805683037.d03921af574c9e368e124258e08ab95d., storeName=d03921af574c9e368e124258e08ab95d/family2, priority=12, startTime=1678805708211; duration=1sec 2023-03-14 14:55:09,474 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=6), splitQueue=0 2023-03-14 14:55:09,474 DEBUG [RS:0;jenkins-hbase20:41317-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-03-14 14:55:09,474 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 541dfbe822716da662f3a573a64aa05f/family1 in testCompactionWithHFileLink,,1678805683037.541dfbe822716da662f3a573a64aa05f. 2023-03-14 14:55:09,474 INFO [RS:0;jenkins-hbase20:41317-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 46b57114435577599b693b836e0ad8d2/family1 in testCompactionWithHFileLink,1,1678805683037.46b57114435577599b693b836e0ad8d2. 2023-03-14 14:55:09,474 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1/testCompactionWithHFileLink=541dfbe822716da662f3a573a64aa05f-70e0f28062314487bee0b6ed2ce10d0b, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1/testCompactionWithHFileLink=541dfbe822716da662f3a573a64aa05f-591c70d95e90448b9e60702762d6fe7b, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1/testCompactionWithHFileLink=541dfbe822716da662f3a573a64aa05f-1b5ac87360aa4bb191cc4449750a7907, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1/testCompactionWithHFileLink=541dfbe822716da662f3a573a64aa05f-3d7816c125124489b2759873bb2274f5, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1/bc1359b033654c9684705786507eb1c8_SeqId_34_] into tmpdir=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/.tmp, totalSize=28.9 K 2023-03-14 14:55:09,474 INFO [RS:0;jenkins-hbase20:41317-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1/testCompactionWithHFileLink=46b57114435577599b693b836e0ad8d2-c9bf5b936237414485b321f354149a3f, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1/testCompactionWithHFileLink=46b57114435577599b693b836e0ad8d2-a6062f3df98748bdabc1471e8d8f1031, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1/testCompactionWithHFileLink=46b57114435577599b693b836e0ad8d2-b19c3c6a9bf5422989ad34b1bd3dd634, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1/testCompactionWithHFileLink=46b57114435577599b693b836e0ad8d2-b3edf5484f304570ace5edaeaed6a1f1, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1/ad4530e0e2ba474bade2d93977f00a65_SeqId_34_] into tmpdir=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/.tmp, totalSize=28.9 K 2023-03-14 14:55:09,475 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=541dfbe822716da662f3a573a64aa05f-70e0f28062314487bee0b6ed2ce10d0b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678805685166 2023-03-14 14:55:09,475 DEBUG [RS:0;jenkins-hbase20:41317-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=46b57114435577599b693b836e0ad8d2-c9bf5b936237414485b321f354149a3f, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678805685168 2023-03-14 14:55:09,475 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=541dfbe822716da662f3a573a64aa05f-591c70d95e90448b9e60702762d6fe7b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678805686981 2023-03-14 14:55:09,475 DEBUG [RS:0;jenkins-hbase20:41317-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=46b57114435577599b693b836e0ad8d2-a6062f3df98748bdabc1471e8d8f1031, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678805686982 2023-03-14 14:55:09,476 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=541dfbe822716da662f3a573a64aa05f-1b5ac87360aa4bb191cc4449750a7907, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678805688804 2023-03-14 14:55:09,476 DEBUG [RS:0;jenkins-hbase20:41317-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=46b57114435577599b693b836e0ad8d2-b19c3c6a9bf5422989ad34b1bd3dd634, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678805688805 2023-03-14 14:55:09,476 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=541dfbe822716da662f3a573a64aa05f-3d7816c125124489b2759873bb2274f5, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678805690217 2023-03-14 14:55:09,476 DEBUG [RS:0;jenkins-hbase20:41317-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=46b57114435577599b693b836e0ad8d2-b3edf5484f304570ace5edaeaed6a1f1, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678805690218 2023-03-14 14:55:09,476 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting bc1359b033654c9684705786507eb1c8_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1678805685166 2023-03-14 14:55:09,477 DEBUG [RS:0;jenkins-hbase20:41317-longCompactions-0] compactions.Compactor(207): Compacting ad4530e0e2ba474bade2d93977f00a65_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1678805685168 2023-03-14 14:55:09,487 INFO [RS:0;jenkins-hbase20:41317-longCompactions-0] throttle.PressureAwareThroughputController(145): 46b57114435577599b693b836e0ad8d2#family1#compaction#116 average throughput is 1.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 1 active operations remaining, total limit is 57.69 MB/second 2023-03-14 14:55:09,487 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] throttle.PressureAwareThroughputController(145): 541dfbe822716da662f3a573a64aa05f#family1#compaction#117 average throughput is 1.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 57.69 MB/second 2023-03-14 14:55:09,533 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family1/testCompactionWithHFileLink=d03921af574c9e368e124258e08ab95d-7bedf33c34414f65b99ef964dca782ad, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family1/testCompactionWithHFileLink=d03921af574c9e368e124258e08ab95d-25a93ba0de464a7680c159909c51660b, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family1/testCompactionWithHFileLink=d03921af574c9e368e124258e08ab95d-0d78103959d84c55bf5fd402a71523ff, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family1/testCompactionWithHFileLink=d03921af574c9e368e124258e08ab95d-ef4e5b48bebf48c4a6d53a9834e30bb5] to archive 2023-03-14 14:55:09,534 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 14:55:09,538 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family1/testCompactionWithHFileLink=d03921af574c9e368e124258e08ab95d-7bedf33c34414f65b99ef964dca782ad to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family1/testCompactionWithHFileLink=d03921af574c9e368e124258e08ab95d-7bedf33c34414f65b99ef964dca782ad 2023-03-14 14:55:09,540 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family1/testCompactionWithHFileLink=d03921af574c9e368e124258e08ab95d-25a93ba0de464a7680c159909c51660b to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family1/testCompactionWithHFileLink=d03921af574c9e368e124258e08ab95d-25a93ba0de464a7680c159909c51660b 2023-03-14 14:55:09,543 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family1/testCompactionWithHFileLink=d03921af574c9e368e124258e08ab95d-0d78103959d84c55bf5fd402a71523ff to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family1/testCompactionWithHFileLink=d03921af574c9e368e124258e08ab95d-0d78103959d84c55bf5fd402a71523ff 2023-03-14 14:55:09,545 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family1/testCompactionWithHFileLink=d03921af574c9e368e124258e08ab95d-ef4e5b48bebf48c4a6d53a9834e30bb5 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family1/testCompactionWithHFileLink=d03921af574c9e368e124258e08ab95d-ef4e5b48bebf48c4a6d53a9834e30bb5 2023-03-14 14:55:09,546 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family2/testCompactionWithHFileLink=d03921af574c9e368e124258e08ab95d-a8d3d3d688f44d5c98b54f77a810edfb, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family2/testCompactionWithHFileLink=d03921af574c9e368e124258e08ab95d-a25e279e24aa4b70919faaa31a07769a, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family2/testCompactionWithHFileLink=d03921af574c9e368e124258e08ab95d-9a13180cb0db4dbd970bf225dcab0e4c, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family2/testCompactionWithHFileLink=d03921af574c9e368e124258e08ab95d-e417dad5ad4041b39481cc378b7bb1d7] to archive 2023-03-14 14:55:09,547 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 14:55:09,548 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family2/testCompactionWithHFileLink=d03921af574c9e368e124258e08ab95d-a8d3d3d688f44d5c98b54f77a810edfb to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family2/testCompactionWithHFileLink=d03921af574c9e368e124258e08ab95d-a8d3d3d688f44d5c98b54f77a810edfb 2023-03-14 14:55:09,549 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family2/testCompactionWithHFileLink=d03921af574c9e368e124258e08ab95d-a25e279e24aa4b70919faaa31a07769a to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family2/testCompactionWithHFileLink=d03921af574c9e368e124258e08ab95d-a25e279e24aa4b70919faaa31a07769a 2023-03-14 14:55:09,550 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family2/testCompactionWithHFileLink=d03921af574c9e368e124258e08ab95d-9a13180cb0db4dbd970bf225dcab0e4c to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family2/testCompactionWithHFileLink=d03921af574c9e368e124258e08ab95d-9a13180cb0db4dbd970bf225dcab0e4c 2023-03-14 14:55:09,550 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family2/testCompactionWithHFileLink=d03921af574c9e368e124258e08ab95d-e417dad5ad4041b39481cc378b7bb1d7 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/family2/testCompactionWithHFileLink=d03921af574c9e368e124258e08ab95d-e417dad5ad4041b39481cc378b7bb1d7 2023-03-14 14:55:09,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=104 2023-03-14 14:55:09,572 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-03-14 14:55:09,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=ns:testMinorCompaction 2023-03-14 14:55:09,573 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-03-14 14:55:09,574 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "ns" qualifier: "testMinorCompaction" procId is: 105 2023-03-14 14:55:09,574 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-14 14:55:09,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-03-14 14:55:09,576 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68 2023-03-14 14:55:09,576 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4 2023-03-14 14:55:09,576 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634 2023-03-14 14:55:09,576 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68 empty. 2023-03-14 14:55:09,576 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634 empty. 2023-03-14 14:55:09,576 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4 empty. 2023-03-14 14:55:09,576 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68 2023-03-14 14:55:09,576 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4 2023-03-14 14:55:09,576 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634 2023-03-14 14:55:09,576 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived ns:testMinorCompaction regions 2023-03-14 14:55:09,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-03-14 14:55:09,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-03-14 14:55:09,983 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/ns/testMinorCompaction/.tabledesc/.tableinfo.0000000001 2023-03-14 14:55:09,985 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => 81d1d1d671b72bf2cfae45402ba07d68, NAME => 'ns:testMinorCompaction,,1678805709571.81d1d1d671b72bf2cfae45402ba07d68.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp 2023-03-14 14:55:09,985 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(7675): creating {ENCODED => 1b57993c9af4fc1b678650e0db6b7634, NAME => 'ns:testMinorCompaction,2,1678805709571.1b57993c9af4fc1b678650e0db6b7634.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp 2023-03-14 14:55:09,985 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(7675): creating {ENCODED => 14e9cbacd99b2cc16b477e8d2c9c88a4, NAME => 'ns:testMinorCompaction,1,1678805709571.14e9cbacd99b2cc16b477e8d2c9c88a4.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp 2023-03-14 14:55:10,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-03-14 14:55:10,392 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1678805709571.1b57993c9af4fc1b678650e0db6b7634.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 14:55:10,392 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1678805709571.14e9cbacd99b2cc16b477e8d2c9c88a4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 14:55:10,392 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1604): Closing 1b57993c9af4fc1b678650e0db6b7634, disabling compactions & flushes 2023-03-14 14:55:10,392 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1604): Closing 14e9cbacd99b2cc16b477e8d2c9c88a4, disabling compactions & flushes 2023-03-14 14:55:10,392 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1678805709571.1b57993c9af4fc1b678650e0db6b7634. 2023-03-14 14:55:10,392 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1678805709571.81d1d1d671b72bf2cfae45402ba07d68.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 14:55:10,392 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1678805709571.14e9cbacd99b2cc16b477e8d2c9c88a4. 2023-03-14 14:55:10,393 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1604): Closing 81d1d1d671b72bf2cfae45402ba07d68, disabling compactions & flushes 2023-03-14 14:55:10,393 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1678805709571.1b57993c9af4fc1b678650e0db6b7634. 2023-03-14 14:55:10,393 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1678805709571.81d1d1d671b72bf2cfae45402ba07d68. 2023-03-14 14:55:10,393 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1678805709571.81d1d1d671b72bf2cfae45402ba07d68. 2023-03-14 14:55:10,393 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1678805709571.81d1d1d671b72bf2cfae45402ba07d68. after waiting 0 ms 2023-03-14 14:55:10,393 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1678805709571.81d1d1d671b72bf2cfae45402ba07d68. 2023-03-14 14:55:10,393 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1678805709571.14e9cbacd99b2cc16b477e8d2c9c88a4. 2023-03-14 14:55:10,393 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1678805709571.81d1d1d671b72bf2cfae45402ba07d68. 2023-03-14 14:55:10,393 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1678805709571.1b57993c9af4fc1b678650e0db6b7634. after waiting 0 ms 2023-03-14 14:55:10,393 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1558): Region close journal for 81d1d1d671b72bf2cfae45402ba07d68: 2023-03-14 14:55:10,393 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1678805709571.14e9cbacd99b2cc16b477e8d2c9c88a4. after waiting 0 ms 2023-03-14 14:55:10,393 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1678805709571.1b57993c9af4fc1b678650e0db6b7634. 2023-03-14 14:55:10,393 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1678805709571.14e9cbacd99b2cc16b477e8d2c9c88a4. 2023-03-14 14:55:10,393 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1678805709571.1b57993c9af4fc1b678650e0db6b7634. 2023-03-14 14:55:10,393 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1558): Region close journal for 1b57993c9af4fc1b678650e0db6b7634: 2023-03-14 14:55:10,393 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1678805709571.14e9cbacd99b2cc16b477e8d2c9c88a4. 2023-03-14 14:55:10,393 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1558): Region close journal for 14e9cbacd99b2cc16b477e8d2c9c88a4: 2023-03-14 14:55:10,395 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-03-14 14:55:10,396 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,,1678805709571.81d1d1d671b72bf2cfae45402ba07d68.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1678805710395"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678805710395"}]},"ts":"1678805710395"} 2023-03-14 14:55:10,396 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,2,1678805709571.1b57993c9af4fc1b678650e0db6b7634.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1678805710395"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678805710395"}]},"ts":"1678805710395"} 2023-03-14 14:55:10,396 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,1,1678805709571.14e9cbacd99b2cc16b477e8d2c9c88a4.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1678805710395"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678805710395"}]},"ts":"1678805710395"} 2023-03-14 14:55:10,397 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-03-14 14:55:10,397 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-14 14:55:10,398 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678805710398"}]},"ts":"1678805710398"} 2023-03-14 14:55:10,399 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLING in hbase:meta 2023-03-14 14:55:10,401 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=81d1d1d671b72bf2cfae45402ba07d68, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=14e9cbacd99b2cc16b477e8d2c9c88a4, ASSIGN}, {pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=1b57993c9af4fc1b678650e0db6b7634, ASSIGN}] 2023-03-14 14:55:10,402 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=1b57993c9af4fc1b678650e0db6b7634, ASSIGN 2023-03-14 14:55:10,402 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=81d1d1d671b72bf2cfae45402ba07d68, ASSIGN 2023-03-14 14:55:10,402 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=14e9cbacd99b2cc16b477e8d2c9c88a4, ASSIGN 2023-03-14 14:55:10,403 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=1b57993c9af4fc1b678650e0db6b7634, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,41317,1678805580877; forceNewPlan=false, retain=false 2023-03-14 14:55:10,403 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=14e9cbacd99b2cc16b477e8d2c9c88a4, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,41317,1678805580877; forceNewPlan=false, retain=false 2023-03-14 14:55:10,403 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=81d1d1d671b72bf2cfae45402ba07d68, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,41317,1678805580877; forceNewPlan=false, retain=false 2023-03-14 14:55:10,411 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-14 14:55:10,556 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=81d1d1d671b72bf2cfae45402ba07d68, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:10,556 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,,1678805709571.81d1d1d671b72bf2cfae45402ba07d68.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1678805710556"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1678805710556"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678805710556"}]},"ts":"1678805710556"} 2023-03-14 14:55:10,556 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=14e9cbacd99b2cc16b477e8d2c9c88a4, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:10,556 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,1,1678805709571.14e9cbacd99b2cc16b477e8d2c9c88a4.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1678805710556"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1678805710556"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678805710556"}]},"ts":"1678805710556"} 2023-03-14 14:55:10,557 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=1b57993c9af4fc1b678650e0db6b7634, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:10,557 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,2,1678805709571.1b57993c9af4fc1b678650e0db6b7634.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1678805710557"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1678805710557"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678805710557"}]},"ts":"1678805710557"} 2023-03-14 14:55:10,559 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure 81d1d1d671b72bf2cfae45402ba07d68, server=jenkins-hbase20.apache.org,41317,1678805580877}] 2023-03-14 14:55:10,560 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=110, ppid=107, state=RUNNABLE; OpenRegionProcedure 14e9cbacd99b2cc16b477e8d2c9c88a4, server=jenkins-hbase20.apache.org,41317,1678805580877}] 2023-03-14 14:55:10,560 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=111, ppid=108, state=RUNNABLE; OpenRegionProcedure 1b57993c9af4fc1b678650e0db6b7634, server=jenkins-hbase20.apache.org,41317,1678805580877}] 2023-03-14 14:55:10,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-03-14 14:55:10,708 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/.tmp/family1/78cd994802f645de8c2034d7bfd909c0 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1/78cd994802f645de8c2034d7bfd909c0 2023-03-14 14:55:10,710 DEBUG [RS:0;jenkins-hbase20:41317-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/.tmp/family1/682d3c4e05854f94b7d60a3e21794d63 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1/682d3c4e05854f94b7d60a3e21794d63 2023-03-14 14:55:10,717 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,,1678805709571.81d1d1d671b72bf2cfae45402ba07d68. 2023-03-14 14:55:10,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 81d1d1d671b72bf2cfae45402ba07d68, NAME => 'ns:testMinorCompaction,,1678805709571.81d1d1d671b72bf2cfae45402ba07d68.', STARTKEY => '', ENDKEY => '1'} 2023-03-14 14:55:10,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 81d1d1d671b72bf2cfae45402ba07d68 2023-03-14 14:55:10,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1678805709571.81d1d1d671b72bf2cfae45402ba07d68.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 14:55:10,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 81d1d1d671b72bf2cfae45402ba07d68 2023-03-14 14:55:10,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 81d1d1d671b72bf2cfae45402ba07d68 2023-03-14 14:55:10,726 INFO [StoreOpener-81d1d1d671b72bf2cfae45402ba07d68-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 81d1d1d671b72bf2cfae45402ba07d68 2023-03-14 14:55:10,729 INFO [RS:0;jenkins-hbase20:41317-longCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in 46b57114435577599b693b836e0ad8d2/family1 of 46b57114435577599b693b836e0ad8d2 into 682d3c4e05854f94b7d60a3e21794d63(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-14 14:55:10,729 DEBUG [RS:0;jenkins-hbase20:41317-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 46b57114435577599b693b836e0ad8d2: 2023-03-14 14:55:10,729 INFO [RS:0;jenkins-hbase20:41317-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,1,1678805683037.46b57114435577599b693b836e0ad8d2., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1678805709408; duration=1sec 2023-03-14 14:55:10,729 DEBUG [RS:0;jenkins-hbase20:41317-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-03-14 14:55:10,729 DEBUG [RS:0;jenkins-hbase20:41317-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-03-14 14:55:10,730 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in 541dfbe822716da662f3a573a64aa05f/family1 of 541dfbe822716da662f3a573a64aa05f into 78cd994802f645de8c2034d7bfd909c0(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-14 14:55:10,730 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 541dfbe822716da662f3a573a64aa05f: 2023-03-14 14:55:10,730 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,,1678805683037.541dfbe822716da662f3a573a64aa05f., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1678805709016; duration=1sec 2023-03-14 14:55:10,730 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-03-14 14:55:10,730 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-03-14 14:55:10,734 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1/testCompactionWithHFileLink=46b57114435577599b693b836e0ad8d2-c9bf5b936237414485b321f354149a3f, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1/testCompactionWithHFileLink=46b57114435577599b693b836e0ad8d2-a6062f3df98748bdabc1471e8d8f1031, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1/testCompactionWithHFileLink=46b57114435577599b693b836e0ad8d2-b19c3c6a9bf5422989ad34b1bd3dd634, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1/testCompactionWithHFileLink=46b57114435577599b693b836e0ad8d2-b3edf5484f304570ace5edaeaed6a1f1, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1/ad4530e0e2ba474bade2d93977f00a65_SeqId_34_] to archive 2023-03-14 14:55:10,735 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 14:55:10,736 DEBUG [StoreOpener-81d1d1d671b72bf2cfae45402ba07d68-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/family1 2023-03-14 14:55:10,736 DEBUG [StoreOpener-81d1d1d671b72bf2cfae45402ba07d68-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/family1 2023-03-14 14:55:10,736 INFO [StoreOpener-81d1d1d671b72bf2cfae45402ba07d68-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 81d1d1d671b72bf2cfae45402ba07d68 columnFamilyName family1 2023-03-14 14:55:10,737 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1/testCompactionWithHFileLink=46b57114435577599b693b836e0ad8d2-c9bf5b936237414485b321f354149a3f to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1/testCompactionWithHFileLink=46b57114435577599b693b836e0ad8d2-c9bf5b936237414485b321f354149a3f 2023-03-14 14:55:10,737 DEBUG [RS:0;jenkins-hbase20:41317-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-03-14 14:55:10,737 DEBUG [RS:0;jenkins-hbase20:41317-longCompactions-0] regionserver.HStore(1912): 46b57114435577599b693b836e0ad8d2/family2 is initiating minor compaction (all files) 2023-03-14 14:55:10,737 INFO [RS:0;jenkins-hbase20:41317-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 46b57114435577599b693b836e0ad8d2/family2 in testCompactionWithHFileLink,1,1678805683037.46b57114435577599b693b836e0ad8d2. 2023-03-14 14:55:10,738 INFO [RS:0;jenkins-hbase20:41317-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family2/testCompactionWithHFileLink=46b57114435577599b693b836e0ad8d2-f50ca180804e42159fa65ddb96403962, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family2/testCompactionWithHFileLink=46b57114435577599b693b836e0ad8d2-b01622885e094dce84b6378c5e6e9a6f, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family2/testCompactionWithHFileLink=46b57114435577599b693b836e0ad8d2-1628452bcbc044978e89d0017623b719, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family2/testCompactionWithHFileLink=46b57114435577599b693b836e0ad8d2-389ec0d426554927a09b80e5c5eafe3e] into tmpdir=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/.tmp, totalSize=20.4 K 2023-03-14 14:55:10,738 INFO [StoreOpener-81d1d1d671b72bf2cfae45402ba07d68-1] regionserver.HStore(310): Store=81d1d1d671b72bf2cfae45402ba07d68/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 14:55:10,738 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1/testCompactionWithHFileLink=46b57114435577599b693b836e0ad8d2-a6062f3df98748bdabc1471e8d8f1031 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1/testCompactionWithHFileLink=46b57114435577599b693b836e0ad8d2-a6062f3df98748bdabc1471e8d8f1031 2023-03-14 14:55:10,738 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-03-14 14:55:10,738 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HStore(1912): 541dfbe822716da662f3a573a64aa05f/family2 is initiating minor compaction (all files) 2023-03-14 14:55:10,738 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 541dfbe822716da662f3a573a64aa05f/family2 in testCompactionWithHFileLink,,1678805683037.541dfbe822716da662f3a573a64aa05f. 2023-03-14 14:55:10,738 INFO [StoreOpener-81d1d1d671b72bf2cfae45402ba07d68-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 81d1d1d671b72bf2cfae45402ba07d68 2023-03-14 14:55:10,738 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family2/testCompactionWithHFileLink=541dfbe822716da662f3a573a64aa05f-3a131025d2344260a03875522668b04a, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family2/testCompactionWithHFileLink=541dfbe822716da662f3a573a64aa05f-04bf20de187e447d8cd4c89e4ba37610, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family2/testCompactionWithHFileLink=541dfbe822716da662f3a573a64aa05f-55badc960cc24ee5ad7320c72ae33a8f, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family2/testCompactionWithHFileLink=541dfbe822716da662f3a573a64aa05f-6c1df25b2a324da6a91f047c43539cd5] into tmpdir=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/.tmp, totalSize=20.4 K 2023-03-14 14:55:10,738 DEBUG [RS:0;jenkins-hbase20:41317-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=46b57114435577599b693b836e0ad8d2-f50ca180804e42159fa65ddb96403962, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678805685168 2023-03-14 14:55:10,739 DEBUG [RS:0;jenkins-hbase20:41317-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=46b57114435577599b693b836e0ad8d2-b01622885e094dce84b6378c5e6e9a6f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678805686982 2023-03-14 14:55:10,740 DEBUG [StoreOpener-81d1d1d671b72bf2cfae45402ba07d68-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/family2 2023-03-14 14:55:10,740 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=541dfbe822716da662f3a573a64aa05f-3a131025d2344260a03875522668b04a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678805685166 2023-03-14 14:55:10,740 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1/testCompactionWithHFileLink=46b57114435577599b693b836e0ad8d2-b19c3c6a9bf5422989ad34b1bd3dd634 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1/testCompactionWithHFileLink=46b57114435577599b693b836e0ad8d2-b19c3c6a9bf5422989ad34b1bd3dd634 2023-03-14 14:55:10,740 DEBUG [StoreOpener-81d1d1d671b72bf2cfae45402ba07d68-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/family2 2023-03-14 14:55:10,740 INFO [StoreOpener-81d1d1d671b72bf2cfae45402ba07d68-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 81d1d1d671b72bf2cfae45402ba07d68 columnFamilyName family2 2023-03-14 14:55:10,740 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=541dfbe822716da662f3a573a64aa05f-04bf20de187e447d8cd4c89e4ba37610, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678805686981 2023-03-14 14:55:10,740 DEBUG [RS:0;jenkins-hbase20:41317-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=46b57114435577599b693b836e0ad8d2-1628452bcbc044978e89d0017623b719, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678805688805 2023-03-14 14:55:10,741 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1/testCompactionWithHFileLink=46b57114435577599b693b836e0ad8d2-b3edf5484f304570ace5edaeaed6a1f1 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1/testCompactionWithHFileLink=46b57114435577599b693b836e0ad8d2-b3edf5484f304570ace5edaeaed6a1f1 2023-03-14 14:55:10,741 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=541dfbe822716da662f3a573a64aa05f-55badc960cc24ee5ad7320c72ae33a8f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678805688804 2023-03-14 14:55:10,741 DEBUG [RS:0;jenkins-hbase20:41317-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=46b57114435577599b693b836e0ad8d2-389ec0d426554927a09b80e5c5eafe3e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678805690218 2023-03-14 14:55:10,741 INFO [StoreOpener-81d1d1d671b72bf2cfae45402ba07d68-1] regionserver.HStore(310): Store=81d1d1d671b72bf2cfae45402ba07d68/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 14:55:10,743 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1/ad4530e0e2ba474bade2d93977f00a65_SeqId_34_ to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family1/ad4530e0e2ba474bade2d93977f00a65_SeqId_34_ 2023-03-14 14:55:10,743 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=541dfbe822716da662f3a573a64aa05f-6c1df25b2a324da6a91f047c43539cd5, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678805690217 2023-03-14 14:55:10,743 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68 2023-03-14 14:55:10,743 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68 2023-03-14 14:55:10,744 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1/testCompactionWithHFileLink=541dfbe822716da662f3a573a64aa05f-70e0f28062314487bee0b6ed2ce10d0b, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1/testCompactionWithHFileLink=541dfbe822716da662f3a573a64aa05f-591c70d95e90448b9e60702762d6fe7b, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1/testCompactionWithHFileLink=541dfbe822716da662f3a573a64aa05f-1b5ac87360aa4bb191cc4449750a7907, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1/testCompactionWithHFileLink=541dfbe822716da662f3a573a64aa05f-3d7816c125124489b2759873bb2274f5, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1/bc1359b033654c9684705786507eb1c8_SeqId_34_] to archive 2023-03-14 14:55:10,745 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 14:55:10,747 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1/testCompactionWithHFileLink=541dfbe822716da662f3a573a64aa05f-70e0f28062314487bee0b6ed2ce10d0b to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1/testCompactionWithHFileLink=541dfbe822716da662f3a573a64aa05f-70e0f28062314487bee0b6ed2ce10d0b 2023-03-14 14:55:10,748 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-14 14:55:10,749 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1/testCompactionWithHFileLink=541dfbe822716da662f3a573a64aa05f-591c70d95e90448b9e60702762d6fe7b to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1/testCompactionWithHFileLink=541dfbe822716da662f3a573a64aa05f-591c70d95e90448b9e60702762d6fe7b 2023-03-14 14:55:10,750 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 81d1d1d671b72bf2cfae45402ba07d68 2023-03-14 14:55:10,758 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1/testCompactionWithHFileLink=541dfbe822716da662f3a573a64aa05f-1b5ac87360aa4bb191cc4449750a7907 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1/testCompactionWithHFileLink=541dfbe822716da662f3a573a64aa05f-1b5ac87360aa4bb191cc4449750a7907 2023-03-14 14:55:10,762 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1/testCompactionWithHFileLink=541dfbe822716da662f3a573a64aa05f-3d7816c125124489b2759873bb2274f5 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1/testCompactionWithHFileLink=541dfbe822716da662f3a573a64aa05f-3d7816c125124489b2759873bb2274f5 2023-03-14 14:55:10,764 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1/bc1359b033654c9684705786507eb1c8_SeqId_34_ to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family1/bc1359b033654c9684705786507eb1c8_SeqId_34_ 2023-03-14 14:55:10,778 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-14 14:55:10,781 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 81d1d1d671b72bf2cfae45402ba07d68; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68316808, jitterRate=0.017999768257141113}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-14 14:55:10,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 81d1d1d671b72bf2cfae45402ba07d68: 2023-03-14 14:55:10,782 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,,1678805709571.81d1d1d671b72bf2cfae45402ba07d68., pid=109, masterSystemTime=1678805710711 2023-03-14 14:55:10,784 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,,1678805709571.81d1d1d671b72bf2cfae45402ba07d68. 2023-03-14 14:55:10,784 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,,1678805709571.81d1d1d671b72bf2cfae45402ba07d68. 2023-03-14 14:55:10,784 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,1,1678805709571.14e9cbacd99b2cc16b477e8d2c9c88a4. 2023-03-14 14:55:10,784 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 14e9cbacd99b2cc16b477e8d2c9c88a4, NAME => 'ns:testMinorCompaction,1,1678805709571.14e9cbacd99b2cc16b477e8d2c9c88a4.', STARTKEY => '1', ENDKEY => '2'} 2023-03-14 14:55:10,784 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=81d1d1d671b72bf2cfae45402ba07d68, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:10,784 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 14e9cbacd99b2cc16b477e8d2c9c88a4 2023-03-14 14:55:10,784 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,,1678805709571.81d1d1d671b72bf2cfae45402ba07d68.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1678805710784"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1678805710784"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678805710784"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678805710784"}]},"ts":"1678805710784"} 2023-03-14 14:55:10,787 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=106 2023-03-14 14:55:10,787 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure 81d1d1d671b72bf2cfae45402ba07d68, server=jenkins-hbase20.apache.org,41317,1678805580877 in 227 msec 2023-03-14 14:55:10,784 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1678805709571.14e9cbacd99b2cc16b477e8d2c9c88a4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 14:55:10,788 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 14e9cbacd99b2cc16b477e8d2c9c88a4 2023-03-14 14:55:10,788 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 14e9cbacd99b2cc16b477e8d2c9c88a4 2023-03-14 14:55:10,789 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=81d1d1d671b72bf2cfae45402ba07d68, ASSIGN in 386 msec 2023-03-14 14:55:10,789 INFO [RS:0;jenkins-hbase20:41317-longCompactions-0] throttle.PressureAwareThroughputController(145): 46b57114435577599b693b836e0ad8d2#family2#compaction#118 average throughput is 0.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 1 active operations remaining, total limit is 57.69 MB/second 2023-03-14 14:55:10,791 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] throttle.PressureAwareThroughputController(145): 541dfbe822716da662f3a573a64aa05f#family2#compaction#119 average throughput is 0.09 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 57.69 MB/second 2023-03-14 14:55:10,794 INFO [StoreOpener-14e9cbacd99b2cc16b477e8d2c9c88a4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 14e9cbacd99b2cc16b477e8d2c9c88a4 2023-03-14 14:55:10,804 DEBUG [StoreOpener-14e9cbacd99b2cc16b477e8d2c9c88a4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/family1 2023-03-14 14:55:10,805 DEBUG [StoreOpener-14e9cbacd99b2cc16b477e8d2c9c88a4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/family1 2023-03-14 14:55:10,805 INFO [StoreOpener-14e9cbacd99b2cc16b477e8d2c9c88a4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 14e9cbacd99b2cc16b477e8d2c9c88a4 columnFamilyName family1 2023-03-14 14:55:10,809 INFO [StoreOpener-14e9cbacd99b2cc16b477e8d2c9c88a4-1] regionserver.HStore(310): Store=14e9cbacd99b2cc16b477e8d2c9c88a4/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 14:55:10,809 INFO [StoreOpener-14e9cbacd99b2cc16b477e8d2c9c88a4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 14e9cbacd99b2cc16b477e8d2c9c88a4 2023-03-14 14:55:10,814 DEBUG [StoreOpener-14e9cbacd99b2cc16b477e8d2c9c88a4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/family2 2023-03-14 14:55:10,814 DEBUG [StoreOpener-14e9cbacd99b2cc16b477e8d2c9c88a4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/family2 2023-03-14 14:55:10,814 INFO [StoreOpener-14e9cbacd99b2cc16b477e8d2c9c88a4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 14e9cbacd99b2cc16b477e8d2c9c88a4 columnFamilyName family2 2023-03-14 14:55:10,815 INFO [StoreOpener-14e9cbacd99b2cc16b477e8d2c9c88a4-1] regionserver.HStore(310): Store=14e9cbacd99b2cc16b477e8d2c9c88a4/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 14:55:10,822 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4 2023-03-14 14:55:10,822 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4 2023-03-14 14:55:10,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-14 14:55:10,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 14e9cbacd99b2cc16b477e8d2c9c88a4 2023-03-14 14:55:10,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-14 14:55:10,832 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 14e9cbacd99b2cc16b477e8d2c9c88a4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69301083, jitterRate=0.032666608691215515}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-14 14:55:10,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 14e9cbacd99b2cc16b477e8d2c9c88a4: 2023-03-14 14:55:10,833 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,1,1678805709571.14e9cbacd99b2cc16b477e8d2c9c88a4., pid=110, masterSystemTime=1678805710711 2023-03-14 14:55:10,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,1,1678805709571.14e9cbacd99b2cc16b477e8d2c9c88a4. 2023-03-14 14:55:10,835 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,1,1678805709571.14e9cbacd99b2cc16b477e8d2c9c88a4. 2023-03-14 14:55:10,835 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,2,1678805709571.1b57993c9af4fc1b678650e0db6b7634. 2023-03-14 14:55:10,835 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=14e9cbacd99b2cc16b477e8d2c9c88a4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:10,835 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,1,1678805709571.14e9cbacd99b2cc16b477e8d2c9c88a4.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1678805710835"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1678805710835"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678805710835"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678805710835"}]},"ts":"1678805710835"} 2023-03-14 14:55:10,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1b57993c9af4fc1b678650e0db6b7634, NAME => 'ns:testMinorCompaction,2,1678805709571.1b57993c9af4fc1b678650e0db6b7634.', STARTKEY => '2', ENDKEY => ''} 2023-03-14 14:55:10,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 1b57993c9af4fc1b678650e0db6b7634 2023-03-14 14:55:10,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1678805709571.1b57993c9af4fc1b678650e0db6b7634.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 14:55:10,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 1b57993c9af4fc1b678650e0db6b7634 2023-03-14 14:55:10,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 1b57993c9af4fc1b678650e0db6b7634 2023-03-14 14:55:10,838 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=110, resume processing ppid=107 2023-03-14 14:55:10,838 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=110, ppid=107, state=SUCCESS; OpenRegionProcedure 14e9cbacd99b2cc16b477e8d2c9c88a4, server=jenkins-hbase20.apache.org,41317,1678805580877 in 277 msec 2023-03-14 14:55:10,845 INFO [StoreOpener-1b57993c9af4fc1b678650e0db6b7634-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 1b57993c9af4fc1b678650e0db6b7634 2023-03-14 14:55:10,849 DEBUG [StoreOpener-1b57993c9af4fc1b678650e0db6b7634-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/family1 2023-03-14 14:55:10,849 DEBUG [StoreOpener-1b57993c9af4fc1b678650e0db6b7634-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/family1 2023-03-14 14:55:10,850 INFO [StoreOpener-1b57993c9af4fc1b678650e0db6b7634-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1b57993c9af4fc1b678650e0db6b7634 columnFamilyName family1 2023-03-14 14:55:10,851 INFO [StoreOpener-1b57993c9af4fc1b678650e0db6b7634-1] regionserver.HStore(310): Store=1b57993c9af4fc1b678650e0db6b7634/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 14:55:10,851 INFO [StoreOpener-1b57993c9af4fc1b678650e0db6b7634-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 1b57993c9af4fc1b678650e0db6b7634 2023-03-14 14:55:10,855 DEBUG [StoreOpener-1b57993c9af4fc1b678650e0db6b7634-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/family2 2023-03-14 14:55:10,855 DEBUG [StoreOpener-1b57993c9af4fc1b678650e0db6b7634-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/family2 2023-03-14 14:55:10,855 INFO [StoreOpener-1b57993c9af4fc1b678650e0db6b7634-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1b57993c9af4fc1b678650e0db6b7634 columnFamilyName family2 2023-03-14 14:55:10,857 INFO [StoreOpener-1b57993c9af4fc1b678650e0db6b7634-1] regionserver.HStore(310): Store=1b57993c9af4fc1b678650e0db6b7634/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 14:55:10,858 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=14e9cbacd99b2cc16b477e8d2c9c88a4, ASSIGN in 437 msec 2023-03-14 14:55:10,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634 2023-03-14 14:55:10,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634 2023-03-14 14:55:10,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-14 14:55:10,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 1b57993c9af4fc1b678650e0db6b7634 2023-03-14 14:55:10,883 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-14 14:55:10,884 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 1b57993c9af4fc1b678650e0db6b7634; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60082589, jitterRate=-0.10469965636730194}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-14 14:55:10,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 1b57993c9af4fc1b678650e0db6b7634: 2023-03-14 14:55:10,885 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,2,1678805709571.1b57993c9af4fc1b678650e0db6b7634., pid=111, masterSystemTime=1678805710711 2023-03-14 14:55:10,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,2,1678805709571.1b57993c9af4fc1b678650e0db6b7634. 2023-03-14 14:55:10,887 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,2,1678805709571.1b57993c9af4fc1b678650e0db6b7634. 2023-03-14 14:55:10,887 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=1b57993c9af4fc1b678650e0db6b7634, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:10,888 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,2,1678805709571.1b57993c9af4fc1b678650e0db6b7634.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1678805710887"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1678805710887"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678805710887"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678805710887"}]},"ts":"1678805710887"} 2023-03-14 14:55:10,893 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=111, resume processing ppid=108 2023-03-14 14:55:10,893 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=111, ppid=108, state=SUCCESS; OpenRegionProcedure 1b57993c9af4fc1b678650e0db6b7634, server=jenkins-hbase20.apache.org,41317,1678805580877 in 329 msec 2023-03-14 14:55:10,894 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=105 2023-03-14 14:55:10,894 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=1b57993c9af4fc1b678650e0db6b7634, ASSIGN in 492 msec 2023-03-14 14:55:10,894 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-14 14:55:10,895 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678805710895"}]},"ts":"1678805710895"} 2023-03-14 14:55:10,898 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLED in hbase:meta 2023-03-14 14:55:10,907 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-03-14 14:55:10,908 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=ns:testMinorCompaction in 1.3350 sec 2023-03-14 14:55:11,293 DEBUG [RS:0;jenkins-hbase20:41317-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/.tmp/family2/96169226ad62428cadc02888d83c1759 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family2/96169226ad62428cadc02888d83c1759 2023-03-14 14:55:11,299 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/.tmp/family2/8fef3bf9c0fc48b68076db501249d6cf as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family2/8fef3bf9c0fc48b68076db501249d6cf 2023-03-14 14:55:11,307 INFO [RS:0;jenkins-hbase20:41317-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 46b57114435577599b693b836e0ad8d2/family2 of 46b57114435577599b693b836e0ad8d2 into 96169226ad62428cadc02888d83c1759(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-14 14:55:11,307 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 541dfbe822716da662f3a573a64aa05f/family2 of 541dfbe822716da662f3a573a64aa05f into 8fef3bf9c0fc48b68076db501249d6cf(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-14 14:55:11,307 DEBUG [RS:0;jenkins-hbase20:41317-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 46b57114435577599b693b836e0ad8d2: 2023-03-14 14:55:11,308 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 541dfbe822716da662f3a573a64aa05f: 2023-03-14 14:55:11,308 INFO [RS:0;jenkins-hbase20:41317-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1678805683037.46b57114435577599b693b836e0ad8d2., storeName=46b57114435577599b693b836e0ad8d2/family2, priority=12, startTime=1678805708284; duration=0sec 2023-03-14 14:55:11,308 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1678805683037.541dfbe822716da662f3a573a64aa05f., storeName=541dfbe822716da662f3a573a64aa05f/family2, priority=12, startTime=1678805708351; duration=0sec 2023-03-14 14:55:11,308 DEBUG [RS:0;jenkins-hbase20:41317-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-03-14 14:55:11,308 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-03-14 14:55:11,308 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-03-14 14:55:11,308 DEBUG [RS:0;jenkins-hbase20:41317-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-03-14 14:55:11,309 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-03-14 14:55:11,309 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-03-14 14:55:11,309 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,1,1678805683037.46b57114435577599b693b836e0ad8d2. because compaction request was cancelled 2023-03-14 14:55:11,309 DEBUG [RS:0;jenkins-hbase20:41317-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-03-14 14:55:11,309 DEBUG [RS:0;jenkins-hbase20:41317-longCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-03-14 14:55:11,309 DEBUG [RS:0;jenkins-hbase20:41317-longCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,,1678805683037.541dfbe822716da662f3a573a64aa05f. because compaction request was cancelled 2023-03-14 14:55:11,333 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family2/testCompactionWithHFileLink=46b57114435577599b693b836e0ad8d2-f50ca180804e42159fa65ddb96403962, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family2/testCompactionWithHFileLink=46b57114435577599b693b836e0ad8d2-b01622885e094dce84b6378c5e6e9a6f, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family2/testCompactionWithHFileLink=46b57114435577599b693b836e0ad8d2-1628452bcbc044978e89d0017623b719, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family2/testCompactionWithHFileLink=46b57114435577599b693b836e0ad8d2-389ec0d426554927a09b80e5c5eafe3e] to archive 2023-03-14 14:55:11,334 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 14:55:11,338 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family2/testCompactionWithHFileLink=46b57114435577599b693b836e0ad8d2-f50ca180804e42159fa65ddb96403962 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family2/testCompactionWithHFileLink=46b57114435577599b693b836e0ad8d2-f50ca180804e42159fa65ddb96403962 2023-03-14 14:55:11,340 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family2/testCompactionWithHFileLink=46b57114435577599b693b836e0ad8d2-b01622885e094dce84b6378c5e6e9a6f to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family2/testCompactionWithHFileLink=46b57114435577599b693b836e0ad8d2-b01622885e094dce84b6378c5e6e9a6f 2023-03-14 14:55:11,342 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family2/testCompactionWithHFileLink=46b57114435577599b693b836e0ad8d2-1628452bcbc044978e89d0017623b719 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family2/testCompactionWithHFileLink=46b57114435577599b693b836e0ad8d2-1628452bcbc044978e89d0017623b719 2023-03-14 14:55:11,343 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family2/testCompactionWithHFileLink=46b57114435577599b693b836e0ad8d2-389ec0d426554927a09b80e5c5eafe3e to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/family2/testCompactionWithHFileLink=46b57114435577599b693b836e0ad8d2-389ec0d426554927a09b80e5c5eafe3e 2023-03-14 14:55:11,344 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family2/testCompactionWithHFileLink=541dfbe822716da662f3a573a64aa05f-3a131025d2344260a03875522668b04a, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family2/testCompactionWithHFileLink=541dfbe822716da662f3a573a64aa05f-04bf20de187e447d8cd4c89e4ba37610, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family2/testCompactionWithHFileLink=541dfbe822716da662f3a573a64aa05f-55badc960cc24ee5ad7320c72ae33a8f, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family2/testCompactionWithHFileLink=541dfbe822716da662f3a573a64aa05f-6c1df25b2a324da6a91f047c43539cd5] to archive 2023-03-14 14:55:11,345 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 14:55:11,349 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family2/testCompactionWithHFileLink=541dfbe822716da662f3a573a64aa05f-3a131025d2344260a03875522668b04a to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family2/testCompactionWithHFileLink=541dfbe822716da662f3a573a64aa05f-3a131025d2344260a03875522668b04a 2023-03-14 14:55:11,356 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family2/testCompactionWithHFileLink=541dfbe822716da662f3a573a64aa05f-04bf20de187e447d8cd4c89e4ba37610 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family2/testCompactionWithHFileLink=541dfbe822716da662f3a573a64aa05f-04bf20de187e447d8cd4c89e4ba37610 2023-03-14 14:55:11,358 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family2/testCompactionWithHFileLink=541dfbe822716da662f3a573a64aa05f-55badc960cc24ee5ad7320c72ae33a8f to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family2/testCompactionWithHFileLink=541dfbe822716da662f3a573a64aa05f-55badc960cc24ee5ad7320c72ae33a8f 2023-03-14 14:55:11,363 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family2/testCompactionWithHFileLink=541dfbe822716da662f3a573a64aa05f-6c1df25b2a324da6a91f047c43539cd5 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/family2/testCompactionWithHFileLink=541dfbe822716da662f3a573a64aa05f-6c1df25b2a324da6a91f047c43539cd5 2023-03-14 14:55:11,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-03-14 14:55:11,683 INFO [Listener at localhost.localdomain/44261] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: ns:testMinorCompaction, procId: 105 completed 2023-03-14 14:55:11,688 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1678805709571.81d1d1d671b72bf2cfae45402ba07d68. with WAL disabled. Data may be lost in the event of a crash. 2023-03-14 14:55:11,689 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1678805709571.14e9cbacd99b2cc16b477e8d2c9c88a4. with WAL disabled. Data may be lost in the event of a crash. 2023-03-14 14:55:11,689 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1678805709571.1b57993c9af4fc1b678650e0db6b7634. with WAL disabled. Data may be lost in the event of a crash. 2023-03-14 14:55:11,691 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:55:11,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-03-14 14:55:11,692 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-03-14 14:55:11,692 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:55:11,692 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-03-14 14:55:11,692 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-03-14 14:55:11,693 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 14:55:11,693 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-14 14:55:11,693 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:11,693 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:55:11,694 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:55:11,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:55:11,694 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:11,694 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:55:11,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-14 14:55:11,698 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 14:55:11,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:55:11,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-14 14:55:11,698 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-03-14 14:55:11,698 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-03-14 14:55:11,699 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-03-14 14:55:11,699 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:55:11,699 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-03-14 14:55:11,699 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1678805709571.1b57993c9af4fc1b678650e0db6b7634. 2023-03-14 14:55:11,699 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1678805709571.1b57993c9af4fc1b678650e0db6b7634. started... 2023-03-14 14:55:11,699 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1678805709571.14e9cbacd99b2cc16b477e8d2c9c88a4. 2023-03-14 14:55:11,699 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1678805709571.14e9cbacd99b2cc16b477e8d2c9c88a4. started... 2023-03-14 14:55:11,699 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-14 14:55:11,703 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1678805709571.81d1d1d671b72bf2cfae45402ba07d68. 2023-03-14 14:55:11,703 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1b57993c9af4fc1b678650e0db6b7634 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-14 14:55:11,703 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:55:11,703 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 14e9cbacd99b2cc16b477e8d2c9c88a4 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-14 14:55:11,703 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1678805709571.81d1d1d671b72bf2cfae45402ba07d68. started... 2023-03-14 14:55:11,703 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 81d1d1d671b72bf2cfae45402ba07d68 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-14 14:55:11,724 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303142c8d4b2901314a56808975a2e9631f55 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202303142c8d4b2901314a56808975a2e9631f55 2023-03-14 14:55:11,732 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023031461a9589fb763498ca372e4cedd3bac30 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023031461a9589fb763498ca372e4cedd3bac30 2023-03-14 14:55:12,131 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/.tmp/family1/ad4765567d7d463199cd36b55cc27a88 2023-03-14 14:55:12,136 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303144fabebc681284895bd5c4a4917770677 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202303144fabebc681284895bd5c4a4917770677 2023-03-14 14:55:12,138 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/.tmp/family1/902d2645f62942ee99dc501025119331 2023-03-14 14:55:12,551 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/.tmp/family1/a779257ddcea4a4dad6ba6ac5ae71a39 2023-03-14 14:55:12,573 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230314d4ae04eae198497cab791bd68d3237ae to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20230314d4ae04eae198497cab791bd68d3237ae 2023-03-14 14:55:12,577 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230314a68342cf1d7f4b648c6bd5fcb90d1c08 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20230314a68342cf1d7f4b648c6bd5fcb90d1c08 2023-03-14 14:55:12,588 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/.tmp/family2/bc23ef9589964c24854e9186235a7525 2023-03-14 14:55:12,588 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/.tmp/family2/9feff6eb173c4d0ebc6cfaecb7fc868f 2023-03-14 14:55:12,599 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/.tmp/family1/902d2645f62942ee99dc501025119331 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/family1/902d2645f62942ee99dc501025119331 2023-03-14 14:55:12,609 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/.tmp/family1/ad4765567d7d463199cd36b55cc27a88 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/family1/ad4765567d7d463199cd36b55cc27a88 2023-03-14 14:55:12,618 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/family1/902d2645f62942ee99dc501025119331, entries=4, sequenceid=5, filesize=5.4 K 2023-03-14 14:55:12,619 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/.tmp/family2/9feff6eb173c4d0ebc6cfaecb7fc868f as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/family2/9feff6eb173c4d0ebc6cfaecb7fc868f 2023-03-14 14:55:12,620 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/family1/ad4765567d7d463199cd36b55cc27a88, entries=4, sequenceid=5, filesize=5.4 K 2023-03-14 14:55:12,623 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/.tmp/family2/bc23ef9589964c24854e9186235a7525 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/family2/bc23ef9589964c24854e9186235a7525 2023-03-14 14:55:12,629 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/family2/9feff6eb173c4d0ebc6cfaecb7fc868f, entries=2, sequenceid=5, filesize=5.1 K 2023-03-14 14:55:12,630 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/family2/bc23ef9589964c24854e9186235a7525, entries=2, sequenceid=5, filesize=5.1 K 2023-03-14 14:55:12,631 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 81d1d1d671b72bf2cfae45402ba07d68 in 928ms, sequenceid=5, compaction requested=false 2023-03-14 14:55:12,631 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'ns:testMinorCompaction' 2023-03-14 14:55:12,631 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 14e9cbacd99b2cc16b477e8d2c9c88a4 in 928ms, sequenceid=5, compaction requested=false 2023-03-14 14:55:12,631 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'ns:testMinorCompaction' 2023-03-14 14:55:12,634 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 81d1d1d671b72bf2cfae45402ba07d68: 2023-03-14 14:55:12,634 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 14e9cbacd99b2cc16b477e8d2c9c88a4: 2023-03-14 14:55:12,634 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1678805709571.81d1d1d671b72bf2cfae45402ba07d68. 2023-03-14 14:55:12,634 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1678805709571.14e9cbacd99b2cc16b477e8d2c9c88a4. 2023-03-14 14:55:12,634 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-14 14:55:12,634 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-14 14:55:12,997 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023031449c1dcc8670a4797848f7884d9d71fbc to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c2023031449c1dcc8670a4797848f7884d9d71fbc 2023-03-14 14:55:13,402 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/.tmp/family2/8753d630b70543f89221e60d3e4b25fb 2023-03-14 14:55:13,406 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/.tmp/family1/a779257ddcea4a4dad6ba6ac5ae71a39 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/family1/a779257ddcea4a4dad6ba6ac5ae71a39 2023-03-14 14:55:13,412 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/family1/a779257ddcea4a4dad6ba6ac5ae71a39, entries=4, sequenceid=5, filesize=5.4 K 2023-03-14 14:55:13,413 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/.tmp/family2/8753d630b70543f89221e60d3e4b25fb as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/family2/8753d630b70543f89221e60d3e4b25fb 2023-03-14 14:55:13,417 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/family2/8753d630b70543f89221e60d3e4b25fb, entries=2, sequenceid=5, filesize=5.1 K 2023-03-14 14:55:13,417 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 1b57993c9af4fc1b678650e0db6b7634 in 1714ms, sequenceid=5, compaction requested=false 2023-03-14 14:55:13,417 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1b57993c9af4fc1b678650e0db6b7634: 2023-03-14 14:55:13,417 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1678805709571.1b57993c9af4fc1b678650e0db6b7634. 2023-03-14 14:55:13,417 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-14 14:55:13,418 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-14 14:55:13,418 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:13,418 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-03-14 14:55:13,418 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-03-14 14:55:13,419 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:13,419 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-14 14:55:13,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:13,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:55:13,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:55:13,419 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-14 14:55:13,419 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:55:13,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:55:13,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:55:13,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-14 14:55:13,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:13,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:55:13,420 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-03-14 14:55:13,420 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@a8916ad[Count = 0] remaining members to acquire global barrier 2023-03-14 14:55:13,420 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-03-14 14:55:13,420 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-14 14:55:13,421 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-14 14:55:13,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-14 14:55:13,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-14 14:55:13,421 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-03-14 14:55:13,421 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-03-14 14:55:13,421 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:55:13,421 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:13,421 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:55:13,422 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-03-14 14:55:13,422 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:55:13,422 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:13,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:13,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:55:13,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:55:13,422 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-03-14 14:55:13,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:55:13,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:55:13,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-14 14:55:13,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:13,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:55:13,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-14 14:55:13,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:13,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:55:13,424 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-03-14 14:55:13,424 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-03-14 14:55:13,424 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:55:13,424 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:55:13,424 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-03-14 14:55:13,424 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:55:13,426 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 14:55:13,426 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:55:13,426 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 14:55:13,426 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 14:55:13,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 14:55:13,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 14:55:13,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:55:13,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:55:13,426 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:13,426 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:55:13,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:55:13,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:55:13,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 14:55:13,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-14 14:55:13,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:55:13,427 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:13,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-14 14:55:13,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:13,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:55:13,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-14 14:55:13,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:13,428 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:13,428 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-14 14:55:13,428 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:55:13,429 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-14 14:55:13,429 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-03-14 14:55:13,429 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:55:13,429 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:13,429 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-14 14:55:13,429 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-14 14:55:13,429 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 14:55:13,429 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-03-14 14:55:13,429 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-03-14 14:55:13,429 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:55:13,429 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:55:13,429 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:55:13,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:55:13,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:55:13,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:55:13,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:55:13,529 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:55:13,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:55:13,531 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1678805709571.81d1d1d671b72bf2cfae45402ba07d68. with WAL disabled. Data may be lost in the event of a crash. 2023-03-14 14:55:13,531 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1678805709571.14e9cbacd99b2cc16b477e8d2c9c88a4. with WAL disabled. Data may be lost in the event of a crash. 2023-03-14 14:55:13,531 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1678805709571.1b57993c9af4fc1b678650e0db6b7634. with WAL disabled. Data may be lost in the event of a crash. 2023-03-14 14:55:13,534 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:55:13,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-03-14 14:55:13,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-03-14 14:55:13,537 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-03-14 14:55:13,537 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:55:13,537 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-03-14 14:55:13,537 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-03-14 14:55:13,537 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 14:55:13,538 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-14 14:55:13,539 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:13,539 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:55:13,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:55:13,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:55:13,539 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:13,539 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:55:13,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-14 14:55:13,540 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 14:55:13,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:55:13,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-14 14:55:13,543 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-03-14 14:55:13,544 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-03-14 14:55:13,544 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-03-14 14:55:13,544 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-03-14 14:55:13,544 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:55:13,544 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-03-14 14:55:13,544 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1678805709571.1b57993c9af4fc1b678650e0db6b7634. 2023-03-14 14:55:13,544 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1678805709571.1b57993c9af4fc1b678650e0db6b7634. started... 2023-03-14 14:55:13,544 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-14 14:55:13,544 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1678805709571.81d1d1d671b72bf2cfae45402ba07d68. 2023-03-14 14:55:13,544 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1678805709571.14e9cbacd99b2cc16b477e8d2c9c88a4. 2023-03-14 14:55:13,544 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1b57993c9af4fc1b678650e0db6b7634 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-14 14:55:13,544 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1678805709571.14e9cbacd99b2cc16b477e8d2c9c88a4. started... 2023-03-14 14:55:13,544 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1678805709571.81d1d1d671b72bf2cfae45402ba07d68. started... 2023-03-14 14:55:13,544 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:55:13,544 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 14e9cbacd99b2cc16b477e8d2c9c88a4 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-14 14:55:13,545 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 81d1d1d671b72bf2cfae45402ba07d68 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-14 14:55:13,569 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023031426530b9965e646c1b416a7ff53131c96 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023031426530b9965e646c1b416a7ff53131c96 2023-03-14 14:55:13,977 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230314667a703624764abe8dcdaf9e8a061442 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230314667a703624764abe8dcdaf9e8a061442 2023-03-14 14:55:13,985 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230314e94b0fb8af0d4349b2820ecd0ff94dcd to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230314e94b0fb8af0d4349b2820ecd0ff94dcd 2023-03-14 14:55:13,987 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/.tmp/family1/bf2722b994ce481ead0f8ebe5475fa77 2023-03-14 14:55:13,994 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/.tmp/family1/da11577bc72241bfb2843af906008854 2023-03-14 14:55:14,392 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/.tmp/family1/5d47628e734046feaae7e722e5007aa7 2023-03-14 14:55:14,405 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230314e58a25d9ec8243519e19d341a9f730be to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20230314e58a25d9ec8243519e19d341a9f730be 2023-03-14 14:55:14,410 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303142d4e2223ee9d4f32b66e0f92c71bf28d to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202303142d4e2223ee9d4f32b66e0f92c71bf28d 2023-03-14 14:55:14,807 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303147f54afee62c048cc9cd7f1c3c6f7c9ed to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202303147f54afee62c048cc9cd7f1c3c6f7c9ed 2023-03-14 14:55:14,813 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/.tmp/family2/1c497c451fe84bf3a7f2aa71301ee73d 2023-03-14 14:55:14,818 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/.tmp/family1/bf2722b994ce481ead0f8ebe5475fa77 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/family1/bf2722b994ce481ead0f8ebe5475fa77 2023-03-14 14:55:14,823 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/family1/bf2722b994ce481ead0f8ebe5475fa77, entries=4, sequenceid=9, filesize=5.4 K 2023-03-14 14:55:14,824 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/.tmp/family2/1c497c451fe84bf3a7f2aa71301ee73d as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/family2/1c497c451fe84bf3a7f2aa71301ee73d 2023-03-14 14:55:14,826 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/.tmp/family2/b0cf4b8d0a0b4d80b3980365ec23fba6 2023-03-14 14:55:14,828 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/family2/1c497c451fe84bf3a7f2aa71301ee73d, entries=2, sequenceid=9, filesize=5.1 K 2023-03-14 14:55:14,829 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 81d1d1d671b72bf2cfae45402ba07d68 in 1284ms, sequenceid=9, compaction requested=false 2023-03-14 14:55:14,829 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 81d1d1d671b72bf2cfae45402ba07d68: 2023-03-14 14:55:14,829 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1678805709571.81d1d1d671b72bf2cfae45402ba07d68. 2023-03-14 14:55:14,829 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-14 14:55:14,830 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/.tmp/family1/da11577bc72241bfb2843af906008854 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/family1/da11577bc72241bfb2843af906008854 2023-03-14 14:55:14,835 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/family1/da11577bc72241bfb2843af906008854, entries=4, sequenceid=9, filesize=5.4 K 2023-03-14 14:55:14,836 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/.tmp/family2/b0cf4b8d0a0b4d80b3980365ec23fba6 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/family2/b0cf4b8d0a0b4d80b3980365ec23fba6 2023-03-14 14:55:14,843 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/family2/b0cf4b8d0a0b4d80b3980365ec23fba6, entries=2, sequenceid=9, filesize=5.1 K 2023-03-14 14:55:14,844 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 14e9cbacd99b2cc16b477e8d2c9c88a4 in 1300ms, sequenceid=9, compaction requested=false 2023-03-14 14:55:14,845 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 14e9cbacd99b2cc16b477e8d2c9c88a4: 2023-03-14 14:55:14,845 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1678805709571.14e9cbacd99b2cc16b477e8d2c9c88a4. 2023-03-14 14:55:14,845 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-14 14:55:15,219 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/.tmp/family2/249bb5fe966142df88d825e78d6da153 2023-03-14 14:55:15,224 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/.tmp/family1/5d47628e734046feaae7e722e5007aa7 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/family1/5d47628e734046feaae7e722e5007aa7 2023-03-14 14:55:15,228 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/family1/5d47628e734046feaae7e722e5007aa7, entries=4, sequenceid=9, filesize=5.4 K 2023-03-14 14:55:15,229 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/.tmp/family2/249bb5fe966142df88d825e78d6da153 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/family2/249bb5fe966142df88d825e78d6da153 2023-03-14 14:55:15,234 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/family2/249bb5fe966142df88d825e78d6da153, entries=2, sequenceid=9, filesize=5.1 K 2023-03-14 14:55:15,235 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 1b57993c9af4fc1b678650e0db6b7634 in 1691ms, sequenceid=9, compaction requested=false 2023-03-14 14:55:15,235 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1b57993c9af4fc1b678650e0db6b7634: 2023-03-14 14:55:15,235 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1678805709571.1b57993c9af4fc1b678650e0db6b7634. 2023-03-14 14:55:15,235 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-14 14:55:15,235 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-14 14:55:15,235 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:15,235 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-03-14 14:55:15,235 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-03-14 14:55:15,241 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:15,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:15,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:55:15,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:55:15,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:55:15,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:55:15,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-14 14:55:15,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:15,242 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-14 14:55:15,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:55:15,242 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-14 14:55:15,242 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:55:15,242 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-03-14 14:55:15,243 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@be095f1[Count = 0] remaining members to acquire global barrier 2023-03-14 14:55:15,243 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-03-14 14:55:15,243 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-14 14:55:15,243 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-14 14:55:15,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-14 14:55:15,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-14 14:55:15,243 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-03-14 14:55:15,243 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-03-14 14:55:15,243 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:55:15,243 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:15,243 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:55:15,244 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:15,244 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-03-14 14:55:15,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:15,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:55:15,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:55:15,244 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:55:15,244 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-03-14 14:55:15,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:55:15,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:55:15,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-14 14:55:15,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:15,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:55:15,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-14 14:55:15,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:15,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:55:15,246 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-03-14 14:55:15,246 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-03-14 14:55:15,246 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:55:15,246 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:55:15,246 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-03-14 14:55:15,246 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:55:15,247 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 14:55:15,247 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 14:55:15,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 14:55:15,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:55:15,247 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:55:15,247 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 14:55:15,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:55:15,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 14:55:15,247 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:55:15,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:55:15,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:55:15,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 14:55:15,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-14 14:55:15,248 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:15,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:55:15,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-14 14:55:15,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:15,249 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:15,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:55:15,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-14 14:55:15,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:15,250 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:55:15,250 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:55:15,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:55:15,250 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:55:15,250 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-03-14 14:55:15,250 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-03-14 14:55:15,250 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:55:15,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:55:15,250 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:15,251 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-14 14:55:15,251 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-14 14:55:15,251 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:15,251 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-14 14:55:15,251 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-14 14:55:15,251 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 14:55:15,251 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-03-14 14:55:15,251 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:55:15,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:55:15,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:55:15,351 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:55:15,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:55:15,353 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1678805709571.81d1d1d671b72bf2cfae45402ba07d68. with WAL disabled. Data may be lost in the event of a crash. 2023-03-14 14:55:15,353 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1678805709571.14e9cbacd99b2cc16b477e8d2c9c88a4. with WAL disabled. Data may be lost in the event of a crash. 2023-03-14 14:55:15,353 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1678805709571.1b57993c9af4fc1b678650e0db6b7634. with WAL disabled. Data may be lost in the event of a crash. 2023-03-14 14:55:15,355 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:55:15,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-03-14 14:55:15,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-03-14 14:55:15,357 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-03-14 14:55:15,357 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:55:15,357 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-03-14 14:55:15,357 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-03-14 14:55:15,358 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 14:55:15,358 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-14 14:55:15,358 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:15,358 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:55:15,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:55:15,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:55:15,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-14 14:55:15,359 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:15,359 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:55:15,359 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 14:55:15,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:55:15,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-14 14:55:15,359 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-03-14 14:55:15,360 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-03-14 14:55:15,360 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-03-14 14:55:15,360 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-03-14 14:55:15,360 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:55:15,360 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-03-14 14:55:15,361 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1678805709571.14e9cbacd99b2cc16b477e8d2c9c88a4. 2023-03-14 14:55:15,361 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1678805709571.81d1d1d671b72bf2cfae45402ba07d68. 2023-03-14 14:55:15,361 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-14 14:55:15,361 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:55:15,361 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1678805709571.81d1d1d671b72bf2cfae45402ba07d68. started... 2023-03-14 14:55:15,361 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1678805709571.14e9cbacd99b2cc16b477e8d2c9c88a4. started... 2023-03-14 14:55:15,361 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1678805709571.1b57993c9af4fc1b678650e0db6b7634. 2023-03-14 14:55:15,361 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 14e9cbacd99b2cc16b477e8d2c9c88a4 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-14 14:55:15,361 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 81d1d1d671b72bf2cfae45402ba07d68 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-14 14:55:15,362 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1678805709571.1b57993c9af4fc1b678650e0db6b7634. started... 2023-03-14 14:55:15,362 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1b57993c9af4fc1b678650e0db6b7634 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-14 14:55:15,795 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230314e938b976db6b4565bf0ffc23ebc18b6c to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230314e938b976db6b4565bf0ffc23ebc18b6c 2023-03-14 14:55:15,803 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230314ae277f750f764d0ca6fd8e7cbe99d378 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230314ae277f750f764d0ca6fd8e7cbe99d378 2023-03-14 14:55:15,804 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/.tmp/family1/09df7a99b5b54b0da34e215307612681 2023-03-14 14:55:15,806 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303147106fa6fd4e849ddb244ef6989b3e684 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202303147106fa6fd4e849ddb244ef6989b3e684 2023-03-14 14:55:15,822 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/.tmp/family1/d47187068d6f4b32810805f9df733df0 2023-03-14 14:55:15,834 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230314f63ba77607e44f25b028a369af968911 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20230314f63ba77607e44f25b028a369af968911 2023-03-14 14:55:16,212 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/.tmp/family1/4439955118d8444e9692fa67971f5395 2023-03-14 14:55:16,220 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-14 14:55:16,230 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230314a5c11f472aa74bf0b1f172a147a9e56a to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20230314a5c11f472aa74bf0b1f172a147a9e56a 2023-03-14 14:55:16,237 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230314ab45ee81d6784d52960dfa051794bc96 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20230314ab45ee81d6784d52960dfa051794bc96 2023-03-14 14:55:16,243 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/.tmp/family2/c496a5213a1e4a5cb8f46137f33efa26 2023-03-14 14:55:16,247 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/.tmp/family1/09df7a99b5b54b0da34e215307612681 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/family1/09df7a99b5b54b0da34e215307612681 2023-03-14 14:55:16,251 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/.tmp/family2/0d703bfeb60c4648a36057ebb1a24f61 2023-03-14 14:55:16,251 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/.tmp/family2/a388be67b15c4276b2c4c1cb1ec0e358 2023-03-14 14:55:16,255 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/family1/09df7a99b5b54b0da34e215307612681, entries=4, sequenceid=13, filesize=5.4 K 2023-03-14 14:55:16,258 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/.tmp/family2/c496a5213a1e4a5cb8f46137f33efa26 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/family2/c496a5213a1e4a5cb8f46137f33efa26 2023-03-14 14:55:16,258 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/.tmp/family1/4439955118d8444e9692fa67971f5395 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/family1/4439955118d8444e9692fa67971f5395 2023-03-14 14:55:16,258 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/.tmp/family1/d47187068d6f4b32810805f9df733df0 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/family1/d47187068d6f4b32810805f9df733df0 2023-03-14 14:55:16,264 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/family2/c496a5213a1e4a5cb8f46137f33efa26, entries=2, sequenceid=13, filesize=5.1 K 2023-03-14 14:55:16,264 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/family1/d47187068d6f4b32810805f9df733df0, entries=4, sequenceid=13, filesize=5.4 K 2023-03-14 14:55:16,266 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 14e9cbacd99b2cc16b477e8d2c9c88a4 in 905ms, sequenceid=13, compaction requested=true 2023-03-14 14:55:16,267 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 14e9cbacd99b2cc16b477e8d2c9c88a4: 2023-03-14 14:55:16,267 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1678805709571.14e9cbacd99b2cc16b477e8d2c9c88a4. 2023-03-14 14:55:16,267 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/.tmp/family2/a388be67b15c4276b2c4c1cb1ec0e358 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/family2/a388be67b15c4276b2c4c1cb1ec0e358 2023-03-14 14:55:16,267 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-14 14:55:16,270 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/family1/4439955118d8444e9692fa67971f5395, entries=4, sequenceid=13, filesize=5.4 K 2023-03-14 14:55:16,271 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/.tmp/family2/0d703bfeb60c4648a36057ebb1a24f61 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/family2/0d703bfeb60c4648a36057ebb1a24f61 2023-03-14 14:55:16,273 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/family2/a388be67b15c4276b2c4c1cb1ec0e358, entries=2, sequenceid=13, filesize=5.1 K 2023-03-14 14:55:16,274 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/family2/0d703bfeb60c4648a36057ebb1a24f61, entries=2, sequenceid=13, filesize=5.1 K 2023-03-14 14:55:16,274 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 81d1d1d671b72bf2cfae45402ba07d68 in 913ms, sequenceid=13, compaction requested=true 2023-03-14 14:55:16,274 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 1b57993c9af4fc1b678650e0db6b7634 in 912ms, sequenceid=13, compaction requested=true 2023-03-14 14:55:16,274 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 81d1d1d671b72bf2cfae45402ba07d68: 2023-03-14 14:55:16,274 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1b57993c9af4fc1b678650e0db6b7634: 2023-03-14 14:55:16,274 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1678805709571.81d1d1d671b72bf2cfae45402ba07d68. 2023-03-14 14:55:16,274 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1678805709571.1b57993c9af4fc1b678650e0db6b7634. 2023-03-14 14:55:16,274 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-14 14:55:16,275 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-14 14:55:16,275 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-14 14:55:16,275 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:16,275 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-03-14 14:55:16,275 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-03-14 14:55:16,276 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:16,276 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-14 14:55:16,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:16,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:55:16,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:55:16,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:55:16,276 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-14 14:55:16,276 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:55:16,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:55:16,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-14 14:55:16,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:16,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:55:16,277 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-03-14 14:55:16,277 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@126a3059[Count = 0] remaining members to acquire global barrier 2023-03-14 14:55:16,277 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-03-14 14:55:16,277 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-14 14:55:16,277 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-14 14:55:16,277 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-14 14:55:16,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-14 14:55:16,278 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-03-14 14:55:16,278 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-03-14 14:55:16,278 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:16,278 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:55:16,278 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:55:16,278 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:16,278 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-03-14 14:55:16,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:16,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:55:16,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:55:16,279 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:55:16,279 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-03-14 14:55:16,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:55:16,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:55:16,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-14 14:55:16,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:16,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:55:16,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-14 14:55:16,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:16,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:55:16,280 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-03-14 14:55:16,280 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-03-14 14:55:16,280 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:55:16,280 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:55:16,280 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-03-14 14:55:16,280 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:55:16,281 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 14:55:16,281 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 14:55:16,281 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 14:55:16,281 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:55:16,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 14:55:16,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 14:55:16,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:55:16,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:55:16,282 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:16,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:55:16,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:55:16,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:55:16,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 14:55:16,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-14 14:55:16,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:55:16,286 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:16,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-14 14:55:16,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:16,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:55:16,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-14 14:55:16,297 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:55:16,297 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:55:16,297 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:55:16,297 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:16,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:55:16,297 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-14 14:55:16,297 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-14 14:55:16,297 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:16,297 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-14 14:55:16,297 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-14 14:55:16,297 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 14:55:16,298 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:55:16,298 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-03-14 14:55:16,298 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:55:16,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:55:16,298 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:55:16,298 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-03-14 14:55:16,298 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-03-14 14:55:16,298 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:55:16,399 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:55:16,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:55:16,401 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1678805709571.81d1d1d671b72bf2cfae45402ba07d68. with WAL disabled. Data may be lost in the event of a crash. 2023-03-14 14:55:16,401 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1678805709571.14e9cbacd99b2cc16b477e8d2c9c88a4. with WAL disabled. Data may be lost in the event of a crash. 2023-03-14 14:55:16,401 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1678805709571.1b57993c9af4fc1b678650e0db6b7634. with WAL disabled. Data may be lost in the event of a crash. 2023-03-14 14:55:16,403 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:55:16,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-03-14 14:55:16,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-03-14 14:55:16,409 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-03-14 14:55:16,409 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:55:16,409 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-03-14 14:55:16,409 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-03-14 14:55:16,410 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 14:55:16,410 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-14 14:55:16,411 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:55:16,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:55:16,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:55:16,411 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:16,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-14 14:55:16,411 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:16,411 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:55:16,411 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 14:55:16,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:55:16,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-14 14:55:16,412 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-03-14 14:55:16,414 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-03-14 14:55:16,414 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-03-14 14:55:16,414 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-03-14 14:55:16,414 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:55:16,414 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-03-14 14:55:16,414 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1678805709571.1b57993c9af4fc1b678650e0db6b7634. 2023-03-14 14:55:16,415 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1678805709571.1b57993c9af4fc1b678650e0db6b7634. started... 2023-03-14 14:55:16,415 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-14 14:55:16,415 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:55:16,415 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1678805709571.14e9cbacd99b2cc16b477e8d2c9c88a4. 2023-03-14 14:55:16,415 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1b57993c9af4fc1b678650e0db6b7634 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-14 14:55:16,415 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1678805709571.81d1d1d671b72bf2cfae45402ba07d68. 2023-03-14 14:55:16,415 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1678805709571.14e9cbacd99b2cc16b477e8d2c9c88a4. started... 2023-03-14 14:55:16,415 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1678805709571.81d1d1d671b72bf2cfae45402ba07d68. started... 2023-03-14 14:55:16,415 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 14e9cbacd99b2cc16b477e8d2c9c88a4 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-14 14:55:16,415 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 81d1d1d671b72bf2cfae45402ba07d68 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-14 14:55:16,436 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230314e517c9b801134b429ed3497967ca7840 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230314e517c9b801134b429ed3497967ca7840 2023-03-14 14:55:16,436 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023031479e2768feacb459a8c4bff02e201668b to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023031479e2768feacb459a8c4bff02e201668b 2023-03-14 14:55:16,843 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303140cb3a78625204534b81fc62a29406825 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202303140cb3a78625204534b81fc62a29406825 2023-03-14 14:55:16,846 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/.tmp/family1/01e7165113c14d6f8dd2dc9c0e8a612f 2023-03-14 14:55:16,860 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/.tmp/family1/913448d0cafa4b32b1f63ef2add99671 2023-03-14 14:55:16,875 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303146954aed5683449dcbed9b7b6edd16054 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202303146954aed5683449dcbed9b7b6edd16054 2023-03-14 14:55:16,881 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/.tmp/family2/1ec3689980534b95a87e9ed0cf2eda74 2023-03-14 14:55:16,884 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/.tmp/family1/913448d0cafa4b32b1f63ef2add99671 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/family1/913448d0cafa4b32b1f63ef2add99671 2023-03-14 14:55:16,887 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/family1/913448d0cafa4b32b1f63ef2add99671, entries=4, sequenceid=17, filesize=5.4 K 2023-03-14 14:55:16,888 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/.tmp/family2/1ec3689980534b95a87e9ed0cf2eda74 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/family2/1ec3689980534b95a87e9ed0cf2eda74 2023-03-14 14:55:16,892 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/family2/1ec3689980534b95a87e9ed0cf2eda74, entries=2, sequenceid=17, filesize=5.1 K 2023-03-14 14:55:16,893 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 1b57993c9af4fc1b678650e0db6b7634 in 478ms, sequenceid=17, compaction requested=true 2023-03-14 14:55:16,893 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1b57993c9af4fc1b678650e0db6b7634: 2023-03-14 14:55:16,893 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1678805709571.1b57993c9af4fc1b678650e0db6b7634. 2023-03-14 14:55:16,893 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-14 14:55:17,253 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/.tmp/family1/700ccca1912e4d17a14608beacb0eba4 2023-03-14 14:55:17,270 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303147467c28122c643d3854ab17cf547966d to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202303147467c28122c643d3854ab17cf547966d 2023-03-14 14:55:17,275 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/.tmp/family2/730d10f3248e4e1dbf48d32c124c1e59 2023-03-14 14:55:17,276 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023031469e05ab8056641f5800c44616aa367a5 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e2023031469e05ab8056641f5800c44616aa367a5 2023-03-14 14:55:17,282 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/.tmp/family1/01e7165113c14d6f8dd2dc9c0e8a612f as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/family1/01e7165113c14d6f8dd2dc9c0e8a612f 2023-03-14 14:55:17,286 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/family1/01e7165113c14d6f8dd2dc9c0e8a612f, entries=4, sequenceid=17, filesize=5.4 K 2023-03-14 14:55:17,287 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/.tmp/family2/730d10f3248e4e1dbf48d32c124c1e59 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/family2/730d10f3248e4e1dbf48d32c124c1e59 2023-03-14 14:55:17,296 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/family2/730d10f3248e4e1dbf48d32c124c1e59, entries=2, sequenceid=17, filesize=5.1 K 2023-03-14 14:55:17,297 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 14e9cbacd99b2cc16b477e8d2c9c88a4 in 882ms, sequenceid=17, compaction requested=true 2023-03-14 14:55:17,297 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 14e9cbacd99b2cc16b477e8d2c9c88a4: 2023-03-14 14:55:17,297 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1678805709571.14e9cbacd99b2cc16b477e8d2c9c88a4. 2023-03-14 14:55:17,297 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-14 14:55:17,685 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/.tmp/family2/1655bc996b71492b9caadce087877497 2023-03-14 14:55:17,692 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/.tmp/family1/700ccca1912e4d17a14608beacb0eba4 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/family1/700ccca1912e4d17a14608beacb0eba4 2023-03-14 14:55:17,697 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/family1/700ccca1912e4d17a14608beacb0eba4, entries=4, sequenceid=17, filesize=5.4 K 2023-03-14 14:55:17,697 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/.tmp/family2/1655bc996b71492b9caadce087877497 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/family2/1655bc996b71492b9caadce087877497 2023-03-14 14:55:17,708 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/family2/1655bc996b71492b9caadce087877497, entries=2, sequenceid=17, filesize=5.1 K 2023-03-14 14:55:17,709 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 81d1d1d671b72bf2cfae45402ba07d68 in 1294ms, sequenceid=17, compaction requested=true 2023-03-14 14:55:17,709 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 81d1d1d671b72bf2cfae45402ba07d68: 2023-03-14 14:55:17,709 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1678805709571.81d1d1d671b72bf2cfae45402ba07d68. 2023-03-14 14:55:17,710 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-14 14:55:17,710 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-14 14:55:17,710 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:17,710 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-03-14 14:55:17,710 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-03-14 14:55:17,711 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:17,711 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-14 14:55:17,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:17,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:55:17,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:55:17,711 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-14 14:55:17,711 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:55:17,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:55:17,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:55:17,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-14 14:55:17,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:17,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:55:17,714 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-03-14 14:55:17,714 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@40880c34[Count = 0] remaining members to acquire global barrier 2023-03-14 14:55:17,714 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-03-14 14:55:17,714 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-14 14:55:17,715 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-14 14:55:17,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-14 14:55:17,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-14 14:55:17,715 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-03-14 14:55:17,715 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-03-14 14:55:17,715 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:55:17,716 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-03-14 14:55:17,716 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:17,716 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-03-14 14:55:17,716 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:55:17,716 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-03-14 14:55:17,716 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:55:17,716 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:55:17,716 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-03-14 14:55:17,716 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:55:17,716 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:55:17,718 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-03-14 14:55:17,718 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 14:55:17,718 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 14:55:17,718 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:55:17,718 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 14:55:17,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 14:55:17,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:55:17,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:55:17,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 14:55:17,719 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:17,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:55:17,719 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:55:17,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:55:17,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-14 14:55:17,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 14:55:17,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:55:17,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-14 14:55:17,720 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:17,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:17,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:55:17,721 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:55:17,721 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:17,721 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:55:17,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:55:17,721 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-03-14 14:55:17,722 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:55:17,721 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:55:17,721 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:55:17,721 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-14 14:55:17,722 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-14 14:55:17,722 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:17,722 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-14 14:55:17,722 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-14 14:55:17,722 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 14:55:17,722 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-03-14 14:55:17,722 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:55:17,724 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:55:17,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:55:17,726 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-03-14 14:55:17,822 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:55:17,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:55:17,835 DEBUG [Listener at localhost.localdomain/44261] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-14 14:55:17,846 DEBUG [Listener at localhost.localdomain/44261] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-14 14:55:17,857 DEBUG [Listener at localhost.localdomain/44261] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-14 14:55:17,859 DEBUG [Listener at localhost.localdomain/44261] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-14 14:55:17,891 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:55:17,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-03-14 14:55:17,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-03-14 14:55:17,893 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-03-14 14:55:17,893 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:55:17,893 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-03-14 14:55:17,893 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-03-14 14:55:17,893 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 14:55:17,893 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-14 14:55:17,894 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:55:17,894 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:55:17,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:55:17,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-14 14:55:17,895 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:17,895 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 14:55:17,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:55:17,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-14 14:55:17,895 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-03-14 14:55:17,895 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:17,895 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:55:17,895 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-03-14 14:55:17,895 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-03-14 14:55:17,895 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-03-14 14:55:17,895 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:55:17,895 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-03-14 14:55:17,896 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1678805709571.1b57993c9af4fc1b678650e0db6b7634. 2023-03-14 14:55:17,896 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1678805709571.1b57993c9af4fc1b678650e0db6b7634. started... 2023-03-14 14:55:17,896 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1678805709571.14e9cbacd99b2cc16b477e8d2c9c88a4. 2023-03-14 14:55:17,896 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1b57993c9af4fc1b678650e0db6b7634 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-14 14:55:17,896 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1678805709571.81d1d1d671b72bf2cfae45402ba07d68. 2023-03-14 14:55:17,896 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1678805709571.14e9cbacd99b2cc16b477e8d2c9c88a4. started... 2023-03-14 14:55:17,896 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-14 14:55:17,896 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:55:17,896 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 14e9cbacd99b2cc16b477e8d2c9c88a4 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-14 14:55:17,896 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1678805709571.81d1d1d671b72bf2cfae45402ba07d68. started... 2023-03-14 14:55:17,896 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 81d1d1d671b72bf2cfae45402ba07d68 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-14 14:55:18,324 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/.tmp/family1/b546b7d19fff4024b6a3a139aef8e59d 2023-03-14 14:55:18,326 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/.tmp/family1/7368f6e25f334e5eaee9ea8771db5406 2023-03-14 14:55:18,327 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b546b7d19fff4024b6a3a139aef8e59d 2023-03-14 14:55:18,329 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7368f6e25f334e5eaee9ea8771db5406 2023-03-14 14:55:18,724 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/.tmp/family1/e7b86564dc274e7eb0cc6e1a7f85308c 2023-03-14 14:55:18,735 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e7b86564dc274e7eb0cc6e1a7f85308c 2023-03-14 14:55:19,143 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/.tmp/family2/5e8dd5e1ddd7422aad0bbaff3bb43504 2023-03-14 14:55:19,143 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/.tmp/family2/0ef9d3003bd94dce9fc5b10b39fe158d 2023-03-14 14:55:19,149 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/.tmp/family2/51606dbeefff4e7a87d96996e0f1d7fe 2023-03-14 14:55:19,152 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5e8dd5e1ddd7422aad0bbaff3bb43504 2023-03-14 14:55:19,153 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0ef9d3003bd94dce9fc5b10b39fe158d 2023-03-14 14:55:19,153 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/.tmp/family1/b546b7d19fff4024b6a3a139aef8e59d as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/family1/b546b7d19fff4024b6a3a139aef8e59d 2023-03-14 14:55:19,154 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/.tmp/family1/7368f6e25f334e5eaee9ea8771db5406 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/family1/7368f6e25f334e5eaee9ea8771db5406 2023-03-14 14:55:19,154 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 51606dbeefff4e7a87d96996e0f1d7fe 2023-03-14 14:55:19,155 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/.tmp/family1/e7b86564dc274e7eb0cc6e1a7f85308c as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/family1/e7b86564dc274e7eb0cc6e1a7f85308c 2023-03-14 14:55:19,158 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7368f6e25f334e5eaee9ea8771db5406 2023-03-14 14:55:19,158 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/family1/7368f6e25f334e5eaee9ea8771db5406, entries=3, sequenceid=23, filesize=5.0 K 2023-03-14 14:55:19,158 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b546b7d19fff4024b6a3a139aef8e59d 2023-03-14 14:55:19,158 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/family1/b546b7d19fff4024b6a3a139aef8e59d, entries=3, sequenceid=23, filesize=5.0 K 2023-03-14 14:55:19,159 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/.tmp/family2/0ef9d3003bd94dce9fc5b10b39fe158d as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/family2/0ef9d3003bd94dce9fc5b10b39fe158d 2023-03-14 14:55:19,159 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/.tmp/family2/5e8dd5e1ddd7422aad0bbaff3bb43504 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/family2/5e8dd5e1ddd7422aad0bbaff3bb43504 2023-03-14 14:55:19,160 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e7b86564dc274e7eb0cc6e1a7f85308c 2023-03-14 14:55:19,160 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/family1/e7b86564dc274e7eb0cc6e1a7f85308c, entries=3, sequenceid=23, filesize=5.0 K 2023-03-14 14:55:19,161 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/.tmp/family2/51606dbeefff4e7a87d96996e0f1d7fe as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/family2/51606dbeefff4e7a87d96996e0f1d7fe 2023-03-14 14:55:19,163 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0ef9d3003bd94dce9fc5b10b39fe158d 2023-03-14 14:55:19,163 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/family2/0ef9d3003bd94dce9fc5b10b39fe158d, entries=1, sequenceid=23, filesize=5.0 K 2023-03-14 14:55:19,164 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5e8dd5e1ddd7422aad0bbaff3bb43504 2023-03-14 14:55:19,164 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/family2/5e8dd5e1ddd7422aad0bbaff3bb43504, entries=1, sequenceid=23, filesize=5.0 K 2023-03-14 14:55:19,164 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 14e9cbacd99b2cc16b477e8d2c9c88a4 in 1268ms, sequenceid=23, compaction requested=true 2023-03-14 14:55:19,164 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 14e9cbacd99b2cc16b477e8d2c9c88a4: 2023-03-14 14:55:19,164 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1678805709571.14e9cbacd99b2cc16b477e8d2c9c88a4. 2023-03-14 14:55:19,164 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-14 14:55:19,164 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 1b57993c9af4fc1b678650e0db6b7634 in 1268ms, sequenceid=23, compaction requested=true 2023-03-14 14:55:19,164 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1b57993c9af4fc1b678650e0db6b7634: 2023-03-14 14:55:19,164 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1678805709571.1b57993c9af4fc1b678650e0db6b7634. 2023-03-14 14:55:19,164 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-14 14:55:19,167 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 51606dbeefff4e7a87d96996e0f1d7fe 2023-03-14 14:55:19,167 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/family2/51606dbeefff4e7a87d96996e0f1d7fe, entries=1, sequenceid=23, filesize=5.0 K 2023-03-14 14:55:19,168 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 81d1d1d671b72bf2cfae45402ba07d68 in 1272ms, sequenceid=23, compaction requested=true 2023-03-14 14:55:19,168 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 81d1d1d671b72bf2cfae45402ba07d68: 2023-03-14 14:55:19,168 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1678805709571.81d1d1d671b72bf2cfae45402ba07d68. 2023-03-14 14:55:19,168 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-14 14:55:19,168 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-14 14:55:19,168 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:19,168 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-03-14 14:55:19,168 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-03-14 14:55:19,169 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:19,169 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-14 14:55:19,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:19,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:55:19,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:55:19,169 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-14 14:55:19,169 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:55:19,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:55:19,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:55:19,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-14 14:55:19,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:19,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:55:19,170 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-03-14 14:55:19,171 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-03-14 14:55:19,171 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4e9d0553[Count = 0] remaining members to acquire global barrier 2023-03-14 14:55:19,171 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-14 14:55:19,172 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-14 14:55:19,172 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-14 14:55:19,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-14 14:55:19,172 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-03-14 14:55:19,172 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:19,173 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:55:19,173 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-03-14 14:55:19,173 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:55:19,173 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-03-14 14:55:19,173 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:55:19,173 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:19,173 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-03-14 14:55:19,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:19,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:55:19,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:55:19,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:55:19,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:55:19,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-14 14:55:19,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:19,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:55:19,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-14 14:55:19,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:19,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:55:19,175 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-03-14 14:55:19,175 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-03-14 14:55:19,175 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:55:19,175 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:55:19,175 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-03-14 14:55:19,175 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:55:19,176 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 14:55:19,176 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:55:19,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 14:55:19,176 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 14:55:19,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 14:55:19,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 14:55:19,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:55:19,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:55:19,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:55:19,176 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:19,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:55:19,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:55:19,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 14:55:19,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-14 14:55:19,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:55:19,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-14 14:55:19,177 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:19,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:19,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:55:19,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-03-14 14:55:19,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:19,178 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:55:19,178 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:19,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:55:19,179 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:55:19,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:55:19,179 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-03-14 14:55:19,179 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:55:19,179 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-14 14:55:19,179 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:55:19,179 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-03-14 14:55:19,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:55:19,179 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-03-14 14:55:19,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:55:19,179 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:19,179 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-03-14 14:55:19,179 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-14 14:55:19,179 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:55:19,179 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-03-14 14:55:19,179 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-03-14 14:55:19,279 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:55:19,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:55:19,281 DEBUG [Listener at localhost.localdomain/44261] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-14 14:55:19,281 DEBUG [Listener at localhost.localdomain/44261] regionserver.HStore(1912): 1b57993c9af4fc1b678650e0db6b7634/family1 is initiating major compaction (all files) 2023-03-14 14:55:19,282 INFO [Listener at localhost.localdomain/44261] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-14 14:55:19,282 INFO [Listener at localhost.localdomain/44261] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-14 14:55:19,283 INFO [Listener at localhost.localdomain/44261] regionserver.HRegion(2259): Starting compaction of 1b57993c9af4fc1b678650e0db6b7634/family1 in ns:testMinorCompaction,2,1678805709571.1b57993c9af4fc1b678650e0db6b7634. 2023-03-14 14:55:19,284 INFO [Listener at localhost.localdomain/44261] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/family1/a779257ddcea4a4dad6ba6ac5ae71a39, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/family1/5d47628e734046feaae7e722e5007aa7, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/family1/d47187068d6f4b32810805f9df733df0, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/family1/913448d0cafa4b32b1f63ef2add99671, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/family1/b546b7d19fff4024b6a3a139aef8e59d] into tmpdir=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/.tmp, totalSize=26.6 K 2023-03-14 14:55:19,285 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting a779257ddcea4a4dad6ba6ac5ae71a39, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678805711689 2023-03-14 14:55:19,286 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting 5d47628e734046feaae7e722e5007aa7, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678805713531 2023-03-14 14:55:19,287 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting d47187068d6f4b32810805f9df733df0, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678805715353 2023-03-14 14:55:19,288 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting 913448d0cafa4b32b1f63ef2add99671, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678805716401 2023-03-14 14:55:19,289 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting b546b7d19fff4024b6a3a139aef8e59d, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-14 14:55:19,300 INFO [Listener at localhost.localdomain/44261] throttle.PressureAwareThroughputController(145): 1b57993c9af4fc1b678650e0db6b7634#family1#compaction#150 average throughput is 0.55 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-14 14:55:19,715 INFO [Listener at localhost.localdomain/44261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230314c450e4d667214f3ab7d1408827b95edd_del 2023-03-14 14:55:19,715 INFO [Listener at localhost.localdomain/44261] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230314c450e4d667214f3ab7d1408827b95edd_del to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230314c450e4d667214f3ab7d1408827b95edd_del 2023-03-14 14:55:20,137 INFO [Listener at localhost.localdomain/44261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a0a44ee5b59a4a32bb7ce5f349dc3412 2023-03-14 14:55:20,138 DEBUG [Listener at localhost.localdomain/44261] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/.tmp/family1/a0a44ee5b59a4a32bb7ce5f349dc3412 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/family1/a0a44ee5b59a4a32bb7ce5f349dc3412 2023-03-14 14:55:20,146 INFO [Listener at localhost.localdomain/44261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a0a44ee5b59a4a32bb7ce5f349dc3412 2023-03-14 14:55:20,147 INFO [Listener at localhost.localdomain/44261] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 1b57993c9af4fc1b678650e0db6b7634/family1 of 1b57993c9af4fc1b678650e0db6b7634 into a0a44ee5b59a4a32bb7ce5f349dc3412(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-14 14:55:20,147 DEBUG [Listener at localhost.localdomain/44261] regionserver.HRegion(2289): Compaction status journal for 1b57993c9af4fc1b678650e0db6b7634: 2023-03-14 14:55:20,148 DEBUG [Listener at localhost.localdomain/44261] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-14 14:55:20,148 DEBUG [Listener at localhost.localdomain/44261] regionserver.HStore(1912): 1b57993c9af4fc1b678650e0db6b7634/family2 is initiating major compaction (all files) 2023-03-14 14:55:20,148 INFO [Listener at localhost.localdomain/44261] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-14 14:55:20,148 INFO [Listener at localhost.localdomain/44261] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-14 14:55:20,149 INFO [Listener at localhost.localdomain/44261] regionserver.HRegion(2259): Starting compaction of 1b57993c9af4fc1b678650e0db6b7634/family2 in ns:testMinorCompaction,2,1678805709571.1b57993c9af4fc1b678650e0db6b7634. 2023-03-14 14:55:20,149 INFO [Listener at localhost.localdomain/44261] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/family2/8753d630b70543f89221e60d3e4b25fb, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/family2/249bb5fe966142df88d825e78d6da153, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/family2/a388be67b15c4276b2c4c1cb1ec0e358, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/family2/1ec3689980534b95a87e9ed0cf2eda74, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/family2/5e8dd5e1ddd7422aad0bbaff3bb43504] into tmpdir=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/.tmp, totalSize=25.3 K 2023-03-14 14:55:20,150 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting 8753d630b70543f89221e60d3e4b25fb, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678805711689 2023-03-14 14:55:20,150 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting 249bb5fe966142df88d825e78d6da153, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678805713531 2023-03-14 14:55:20,151 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting a388be67b15c4276b2c4c1cb1ec0e358, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678805715353 2023-03-14 14:55:20,151 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting 1ec3689980534b95a87e9ed0cf2eda74, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678805716401 2023-03-14 14:55:20,152 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting 5e8dd5e1ddd7422aad0bbaff3bb43504, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-14 14:55:20,164 INFO [Listener at localhost.localdomain/44261] throttle.PressureAwareThroughputController(145): 1b57993c9af4fc1b678650e0db6b7634#family2#compaction#151 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-14 14:55:20,233 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/family1/a779257ddcea4a4dad6ba6ac5ae71a39, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/family1/5d47628e734046feaae7e722e5007aa7, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/family1/d47187068d6f4b32810805f9df733df0, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/family1/913448d0cafa4b32b1f63ef2add99671, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/family1/b546b7d19fff4024b6a3a139aef8e59d] to archive 2023-03-14 14:55:20,236 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 14:55:20,241 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/family1/a779257ddcea4a4dad6ba6ac5ae71a39 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/family1/a779257ddcea4a4dad6ba6ac5ae71a39 2023-03-14 14:55:20,245 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/family1/5d47628e734046feaae7e722e5007aa7 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/family1/5d47628e734046feaae7e722e5007aa7 2023-03-14 14:55:20,248 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/family1/d47187068d6f4b32810805f9df733df0 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/family1/d47187068d6f4b32810805f9df733df0 2023-03-14 14:55:20,250 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/family1/913448d0cafa4b32b1f63ef2add99671 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/family1/913448d0cafa4b32b1f63ef2add99671 2023-03-14 14:55:20,252 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/family1/b546b7d19fff4024b6a3a139aef8e59d to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/family1/b546b7d19fff4024b6a3a139aef8e59d 2023-03-14 14:55:20,590 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-14 14:55:20,590 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3b4b040e to 127.0.0.1:50211 2023-03-14 14:55:20,590 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-14 14:55:20,590 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-14 14:55:20,590 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x47167425 to 127.0.0.1:50211 2023-03-14 14:55:20,590 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-14 14:55:20,592 INFO [Listener at localhost.localdomain/44261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230314b7dee8950cd94281b8db9e105ee11719_del 2023-03-14 14:55:20,592 INFO [Listener at localhost.localdomain/44261] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230314b7dee8950cd94281b8db9e105ee11719_del to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20230314b7dee8950cd94281b8db9e105ee11719_del 2023-03-14 14:55:21,414 INFO [Listener at localhost.localdomain/44261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 37a30d5008864143afb38e47ad4514da 2023-03-14 14:55:21,415 DEBUG [Listener at localhost.localdomain/44261] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/.tmp/family2/37a30d5008864143afb38e47ad4514da as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/family2/37a30d5008864143afb38e47ad4514da 2023-03-14 14:55:21,420 INFO [Listener at localhost.localdomain/44261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 37a30d5008864143afb38e47ad4514da 2023-03-14 14:55:21,422 INFO [Listener at localhost.localdomain/44261] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 1b57993c9af4fc1b678650e0db6b7634/family2 of 1b57993c9af4fc1b678650e0db6b7634 into 37a30d5008864143afb38e47ad4514da(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-14 14:55:21,422 DEBUG [Listener at localhost.localdomain/44261] regionserver.HRegion(2289): Compaction status journal for 1b57993c9af4fc1b678650e0db6b7634: 2023-03-14 14:55:21,422 DEBUG [Listener at localhost.localdomain/44261] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-14 14:55:21,422 DEBUG [Listener at localhost.localdomain/44261] regionserver.HStore(1912): 14e9cbacd99b2cc16b477e8d2c9c88a4/family1 is initiating major compaction (all files) 2023-03-14 14:55:21,422 INFO [Listener at localhost.localdomain/44261] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-14 14:55:21,423 INFO [Listener at localhost.localdomain/44261] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-14 14:55:21,423 INFO [Listener at localhost.localdomain/44261] regionserver.HRegion(2259): Starting compaction of 14e9cbacd99b2cc16b477e8d2c9c88a4/family1 in ns:testMinorCompaction,1,1678805709571.14e9cbacd99b2cc16b477e8d2c9c88a4. 2023-03-14 14:55:21,423 INFO [Listener at localhost.localdomain/44261] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/family1/902d2645f62942ee99dc501025119331, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/family1/da11577bc72241bfb2843af906008854, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/family1/09df7a99b5b54b0da34e215307612681, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/family1/01e7165113c14d6f8dd2dc9c0e8a612f, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/family1/7368f6e25f334e5eaee9ea8771db5406] into tmpdir=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/.tmp, totalSize=26.6 K 2023-03-14 14:55:21,424 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting 902d2645f62942ee99dc501025119331, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678805711689 2023-03-14 14:55:21,424 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting da11577bc72241bfb2843af906008854, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678805713531 2023-03-14 14:55:21,425 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting 09df7a99b5b54b0da34e215307612681, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678805715353 2023-03-14 14:55:21,426 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting 01e7165113c14d6f8dd2dc9c0e8a612f, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678805716401 2023-03-14 14:55:21,426 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting 7368f6e25f334e5eaee9ea8771db5406, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-14 14:55:21,433 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/family2/8753d630b70543f89221e60d3e4b25fb, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/family2/249bb5fe966142df88d825e78d6da153, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/family2/a388be67b15c4276b2c4c1cb1ec0e358, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/family2/1ec3689980534b95a87e9ed0cf2eda74, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/family2/5e8dd5e1ddd7422aad0bbaff3bb43504] to archive 2023-03-14 14:55:21,434 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 14:55:21,435 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/family2/8753d630b70543f89221e60d3e4b25fb to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/family2/8753d630b70543f89221e60d3e4b25fb 2023-03-14 14:55:21,435 INFO [Listener at localhost.localdomain/44261] throttle.PressureAwareThroughputController(145): 14e9cbacd99b2cc16b477e8d2c9c88a4#family1#compaction#152 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-14 14:55:21,436 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/family2/249bb5fe966142df88d825e78d6da153 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/family2/249bb5fe966142df88d825e78d6da153 2023-03-14 14:55:21,437 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/family2/a388be67b15c4276b2c4c1cb1ec0e358 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/family2/a388be67b15c4276b2c4c1cb1ec0e358 2023-03-14 14:55:21,438 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/family2/1ec3689980534b95a87e9ed0cf2eda74 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/family2/1ec3689980534b95a87e9ed0cf2eda74 2023-03-14 14:55:21,439 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/family2/5e8dd5e1ddd7422aad0bbaff3bb43504 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/family2/5e8dd5e1ddd7422aad0bbaff3bb43504 2023-03-14 14:55:21,441 INFO [Listener at localhost.localdomain/44261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230314c0aabe0778e245e5bf4f17a85cf4f645_del 2023-03-14 14:55:21,441 INFO [Listener at localhost.localdomain/44261] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230314c0aabe0778e245e5bf4f17a85cf4f645_del to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230314c0aabe0778e245e5bf4f17a85cf4f645_del 2023-03-14 14:55:22,266 INFO [Listener at localhost.localdomain/44261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 93dc3e0cba2f4a2e95288000dd7d98f1 2023-03-14 14:55:22,268 DEBUG [Listener at localhost.localdomain/44261] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/.tmp/family1/93dc3e0cba2f4a2e95288000dd7d98f1 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/family1/93dc3e0cba2f4a2e95288000dd7d98f1 2023-03-14 14:55:22,277 INFO [Listener at localhost.localdomain/44261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 93dc3e0cba2f4a2e95288000dd7d98f1 2023-03-14 14:55:22,278 INFO [Listener at localhost.localdomain/44261] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 14e9cbacd99b2cc16b477e8d2c9c88a4/family1 of 14e9cbacd99b2cc16b477e8d2c9c88a4 into 93dc3e0cba2f4a2e95288000dd7d98f1(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-14 14:55:22,278 DEBUG [Listener at localhost.localdomain/44261] regionserver.HRegion(2289): Compaction status journal for 14e9cbacd99b2cc16b477e8d2c9c88a4: 2023-03-14 14:55:22,278 DEBUG [Listener at localhost.localdomain/44261] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-14 14:55:22,278 DEBUG [Listener at localhost.localdomain/44261] regionserver.HStore(1912): 14e9cbacd99b2cc16b477e8d2c9c88a4/family2 is initiating major compaction (all files) 2023-03-14 14:55:22,278 INFO [Listener at localhost.localdomain/44261] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-14 14:55:22,278 INFO [Listener at localhost.localdomain/44261] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-14 14:55:22,279 INFO [Listener at localhost.localdomain/44261] regionserver.HRegion(2259): Starting compaction of 14e9cbacd99b2cc16b477e8d2c9c88a4/family2 in ns:testMinorCompaction,1,1678805709571.14e9cbacd99b2cc16b477e8d2c9c88a4. 2023-03-14 14:55:22,280 INFO [Listener at localhost.localdomain/44261] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/family2/9feff6eb173c4d0ebc6cfaecb7fc868f, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/family2/b0cf4b8d0a0b4d80b3980365ec23fba6, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/family2/c496a5213a1e4a5cb8f46137f33efa26, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/family2/730d10f3248e4e1dbf48d32c124c1e59, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/family2/0ef9d3003bd94dce9fc5b10b39fe158d] into tmpdir=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/.tmp, totalSize=25.3 K 2023-03-14 14:55:22,280 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting 9feff6eb173c4d0ebc6cfaecb7fc868f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678805711689 2023-03-14 14:55:22,281 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting b0cf4b8d0a0b4d80b3980365ec23fba6, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678805713531 2023-03-14 14:55:22,281 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting c496a5213a1e4a5cb8f46137f33efa26, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678805715353 2023-03-14 14:55:22,282 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting 730d10f3248e4e1dbf48d32c124c1e59, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678805716401 2023-03-14 14:55:22,282 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting 0ef9d3003bd94dce9fc5b10b39fe158d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-14 14:55:22,289 INFO [Listener at localhost.localdomain/44261] throttle.PressureAwareThroughputController(145): 14e9cbacd99b2cc16b477e8d2c9c88a4#family2#compaction#153 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-14 14:55:22,338 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/family1/902d2645f62942ee99dc501025119331, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/family1/da11577bc72241bfb2843af906008854, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/family1/09df7a99b5b54b0da34e215307612681, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/family1/01e7165113c14d6f8dd2dc9c0e8a612f, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/family1/7368f6e25f334e5eaee9ea8771db5406] to archive 2023-03-14 14:55:22,340 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 14:55:22,343 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/family1/902d2645f62942ee99dc501025119331 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/family1/902d2645f62942ee99dc501025119331 2023-03-14 14:55:22,346 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/family1/da11577bc72241bfb2843af906008854 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/family1/da11577bc72241bfb2843af906008854 2023-03-14 14:55:22,349 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/family1/09df7a99b5b54b0da34e215307612681 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/family1/09df7a99b5b54b0da34e215307612681 2023-03-14 14:55:22,351 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/family1/01e7165113c14d6f8dd2dc9c0e8a612f to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/family1/01e7165113c14d6f8dd2dc9c0e8a612f 2023-03-14 14:55:22,353 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/family1/7368f6e25f334e5eaee9ea8771db5406 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/family1/7368f6e25f334e5eaee9ea8771db5406 2023-03-14 14:55:22,703 INFO [Listener at localhost.localdomain/44261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023031457157911f7894bb5b176abd053a04962_del 2023-03-14 14:55:22,703 INFO [Listener at localhost.localdomain/44261] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023031457157911f7894bb5b176abd053a04962_del to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b2023031457157911f7894bb5b176abd053a04962_del 2023-03-14 14:55:23,536 INFO [Listener at localhost.localdomain/44261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a1820d1605cf4a469d82373aefbaddfe 2023-03-14 14:55:23,537 DEBUG [Listener at localhost.localdomain/44261] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/.tmp/family2/a1820d1605cf4a469d82373aefbaddfe as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/family2/a1820d1605cf4a469d82373aefbaddfe 2023-03-14 14:55:23,542 INFO [Listener at localhost.localdomain/44261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a1820d1605cf4a469d82373aefbaddfe 2023-03-14 14:55:23,543 INFO [Listener at localhost.localdomain/44261] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 14e9cbacd99b2cc16b477e8d2c9c88a4/family2 of 14e9cbacd99b2cc16b477e8d2c9c88a4 into a1820d1605cf4a469d82373aefbaddfe(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-14 14:55:23,543 DEBUG [Listener at localhost.localdomain/44261] regionserver.HRegion(2289): Compaction status journal for 14e9cbacd99b2cc16b477e8d2c9c88a4: 2023-03-14 14:55:23,544 DEBUG [Listener at localhost.localdomain/44261] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-14 14:55:23,544 DEBUG [Listener at localhost.localdomain/44261] regionserver.HStore(1912): 81d1d1d671b72bf2cfae45402ba07d68/family1 is initiating major compaction (all files) 2023-03-14 14:55:23,544 INFO [Listener at localhost.localdomain/44261] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-14 14:55:23,544 INFO [Listener at localhost.localdomain/44261] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-14 14:55:23,544 INFO [Listener at localhost.localdomain/44261] regionserver.HRegion(2259): Starting compaction of 81d1d1d671b72bf2cfae45402ba07d68/family1 in ns:testMinorCompaction,,1678805709571.81d1d1d671b72bf2cfae45402ba07d68. 2023-03-14 14:55:23,544 INFO [Listener at localhost.localdomain/44261] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/family1/ad4765567d7d463199cd36b55cc27a88, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/family1/bf2722b994ce481ead0f8ebe5475fa77, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/family1/4439955118d8444e9692fa67971f5395, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/family1/700ccca1912e4d17a14608beacb0eba4, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/family1/e7b86564dc274e7eb0cc6e1a7f85308c] into tmpdir=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/.tmp, totalSize=26.6 K 2023-03-14 14:55:23,545 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting ad4765567d7d463199cd36b55cc27a88, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678805711688 2023-03-14 14:55:23,545 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting bf2722b994ce481ead0f8ebe5475fa77, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678805713531 2023-03-14 14:55:23,546 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting 4439955118d8444e9692fa67971f5395, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678805715353 2023-03-14 14:55:23,546 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting 700ccca1912e4d17a14608beacb0eba4, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678805716400 2023-03-14 14:55:23,546 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting e7b86564dc274e7eb0cc6e1a7f85308c, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-14 14:55:23,555 INFO [Listener at localhost.localdomain/44261] throttle.PressureAwareThroughputController(145): 81d1d1d671b72bf2cfae45402ba07d68#family1#compaction#154 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-14 14:55:23,634 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/family2/9feff6eb173c4d0ebc6cfaecb7fc868f, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/family2/b0cf4b8d0a0b4d80b3980365ec23fba6, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/family2/c496a5213a1e4a5cb8f46137f33efa26, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/family2/730d10f3248e4e1dbf48d32c124c1e59, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/family2/0ef9d3003bd94dce9fc5b10b39fe158d] to archive 2023-03-14 14:55:23,635 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 14:55:23,640 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/family2/9feff6eb173c4d0ebc6cfaecb7fc868f to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/family2/9feff6eb173c4d0ebc6cfaecb7fc868f 2023-03-14 14:55:23,644 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/family2/b0cf4b8d0a0b4d80b3980365ec23fba6 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/family2/b0cf4b8d0a0b4d80b3980365ec23fba6 2023-03-14 14:55:23,646 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/family2/c496a5213a1e4a5cb8f46137f33efa26 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/family2/c496a5213a1e4a5cb8f46137f33efa26 2023-03-14 14:55:23,648 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/family2/730d10f3248e4e1dbf48d32c124c1e59 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/family2/730d10f3248e4e1dbf48d32c124c1e59 2023-03-14 14:55:23,649 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/family2/0ef9d3003bd94dce9fc5b10b39fe158d to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/family2/0ef9d3003bd94dce9fc5b10b39fe158d 2023-03-14 14:55:23,972 INFO [Listener at localhost.localdomain/44261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202303141bc40aa1e10c42618ccafe94df9d6ce0_del 2023-03-14 14:55:23,972 INFO [Listener at localhost.localdomain/44261] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303141bc40aa1e10c42618ccafe94df9d6ce0_del to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202303141bc40aa1e10c42618ccafe94df9d6ce0_del 2023-03-14 14:55:24,948 INFO [Listener at localhost.localdomain/44261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2d9097afdb2544d8a08ac09ad50d9235 2023-03-14 14:55:24,949 DEBUG [Listener at localhost.localdomain/44261] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/.tmp/family1/2d9097afdb2544d8a08ac09ad50d9235 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/family1/2d9097afdb2544d8a08ac09ad50d9235 2023-03-14 14:55:24,955 INFO [Listener at localhost.localdomain/44261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2d9097afdb2544d8a08ac09ad50d9235 2023-03-14 14:55:24,956 INFO [Listener at localhost.localdomain/44261] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 81d1d1d671b72bf2cfae45402ba07d68/family1 of 81d1d1d671b72bf2cfae45402ba07d68 into 2d9097afdb2544d8a08ac09ad50d9235(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-14 14:55:24,957 DEBUG [Listener at localhost.localdomain/44261] regionserver.HRegion(2289): Compaction status journal for 81d1d1d671b72bf2cfae45402ba07d68: 2023-03-14 14:55:24,957 DEBUG [Listener at localhost.localdomain/44261] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-14 14:55:24,957 DEBUG [Listener at localhost.localdomain/44261] regionserver.HStore(1912): 81d1d1d671b72bf2cfae45402ba07d68/family2 is initiating major compaction (all files) 2023-03-14 14:55:24,957 INFO [Listener at localhost.localdomain/44261] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-14 14:55:24,957 INFO [Listener at localhost.localdomain/44261] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-14 14:55:24,957 INFO [Listener at localhost.localdomain/44261] regionserver.HRegion(2259): Starting compaction of 81d1d1d671b72bf2cfae45402ba07d68/family2 in ns:testMinorCompaction,,1678805709571.81d1d1d671b72bf2cfae45402ba07d68. 2023-03-14 14:55:24,958 INFO [Listener at localhost.localdomain/44261] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/family2/bc23ef9589964c24854e9186235a7525, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/family2/1c497c451fe84bf3a7f2aa71301ee73d, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/family2/0d703bfeb60c4648a36057ebb1a24f61, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/family2/1655bc996b71492b9caadce087877497, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/family2/51606dbeefff4e7a87d96996e0f1d7fe] into tmpdir=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/.tmp, totalSize=25.3 K 2023-03-14 14:55:24,958 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting bc23ef9589964c24854e9186235a7525, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678805711688 2023-03-14 14:55:24,959 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting 1c497c451fe84bf3a7f2aa71301ee73d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678805713531 2023-03-14 14:55:24,960 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting 0d703bfeb60c4648a36057ebb1a24f61, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678805715353 2023-03-14 14:55:24,960 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting 1655bc996b71492b9caadce087877497, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678805716400 2023-03-14 14:55:24,961 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting 51606dbeefff4e7a87d96996e0f1d7fe, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-14 14:55:24,970 INFO [Listener at localhost.localdomain/44261] throttle.PressureAwareThroughputController(145): 81d1d1d671b72bf2cfae45402ba07d68#family2#compaction#155 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-14 14:55:25,033 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/family1/ad4765567d7d463199cd36b55cc27a88, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/family1/bf2722b994ce481ead0f8ebe5475fa77, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/family1/4439955118d8444e9692fa67971f5395, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/family1/700ccca1912e4d17a14608beacb0eba4, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/family1/e7b86564dc274e7eb0cc6e1a7f85308c] to archive 2023-03-14 14:55:25,034 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 14:55:25,037 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/family1/ad4765567d7d463199cd36b55cc27a88 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/family1/ad4765567d7d463199cd36b55cc27a88 2023-03-14 14:55:25,040 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/family1/bf2722b994ce481ead0f8ebe5475fa77 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/family1/bf2722b994ce481ead0f8ebe5475fa77 2023-03-14 14:55:25,043 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/family1/4439955118d8444e9692fa67971f5395 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/family1/4439955118d8444e9692fa67971f5395 2023-03-14 14:55:25,045 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/family1/700ccca1912e4d17a14608beacb0eba4 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/family1/700ccca1912e4d17a14608beacb0eba4 2023-03-14 14:55:25,048 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/family1/e7b86564dc274e7eb0cc6e1a7f85308c to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/family1/e7b86564dc274e7eb0cc6e1a7f85308c 2023-03-14 14:55:25,386 INFO [Listener at localhost.localdomain/44261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202303146163a842bde3489d9e1ad2488c447026_del 2023-03-14 14:55:25,386 INFO [Listener at localhost.localdomain/44261] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303146163a842bde3489d9e1ad2488c447026_del to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202303146163a842bde3489d9e1ad2488c447026_del 2023-03-14 14:55:25,812 INFO [Listener at localhost.localdomain/44261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ad8e6e4f9b854fdb8d0765e09a594301 2023-03-14 14:55:25,813 DEBUG [Listener at localhost.localdomain/44261] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/.tmp/family2/ad8e6e4f9b854fdb8d0765e09a594301 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/family2/ad8e6e4f9b854fdb8d0765e09a594301 2023-03-14 14:55:25,819 INFO [Listener at localhost.localdomain/44261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ad8e6e4f9b854fdb8d0765e09a594301 2023-03-14 14:55:25,820 INFO [Listener at localhost.localdomain/44261] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 81d1d1d671b72bf2cfae45402ba07d68/family2 of 81d1d1d671b72bf2cfae45402ba07d68 into ad8e6e4f9b854fdb8d0765e09a594301(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-14 14:55:25,821 DEBUG [Listener at localhost.localdomain/44261] regionserver.HRegion(2289): Compaction status journal for 81d1d1d671b72bf2cfae45402ba07d68: 2023-03-14 14:55:25,825 DEBUG [Listener at localhost.localdomain/44261] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-14 14:55:25,830 DEBUG [Listener at localhost.localdomain/44261] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-14 14:55:25,833 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/family2/bc23ef9589964c24854e9186235a7525, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/family2/1c497c451fe84bf3a7f2aa71301ee73d, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/family2/0d703bfeb60c4648a36057ebb1a24f61, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/family2/1655bc996b71492b9caadce087877497, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/family2/51606dbeefff4e7a87d96996e0f1d7fe] to archive 2023-03-14 14:55:25,834 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 14:55:25,835 DEBUG [Listener at localhost.localdomain/44261] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-14 14:55:25,837 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/family2/bc23ef9589964c24854e9186235a7525 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/family2/bc23ef9589964c24854e9186235a7525 2023-03-14 14:55:25,837 DEBUG [Listener at localhost.localdomain/44261] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-14 14:55:25,838 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/family2/1c497c451fe84bf3a7f2aa71301ee73d to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/family2/1c497c451fe84bf3a7f2aa71301ee73d 2023-03-14 14:55:25,839 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/family2/0d703bfeb60c4648a36057ebb1a24f61 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/family2/0d703bfeb60c4648a36057ebb1a24f61 2023-03-14 14:55:25,841 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/family2/1655bc996b71492b9caadce087877497 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/family2/1655bc996b71492b9caadce087877497 2023-03-14 14:55:25,842 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/family2/51606dbeefff4e7a87d96996e0f1d7fe to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/family2/51606dbeefff4e7a87d96996e0f1d7fe 2023-03-14 14:55:25,842 INFO [Listener at localhost.localdomain/44261] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-03-14 14:55:25,857 INFO [Listener at localhost.localdomain/44261] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 3 del files, 3 selected files, and 0 irrelevant files table 'ns:testMinorCompaction' and column 'family1' 2023-03-14 14:55:25,859 INFO [Listener at localhost.localdomain/44261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202303141bc40aa1e10c42618ccafe94df9d6ce0_del 2023-03-14 14:55:25,862 INFO [Listener at localhost.localdomain/44261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230314c0aabe0778e245e5bf4f17a85cf4f645_del 2023-03-14 14:55:25,864 INFO [Listener at localhost.localdomain/44261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230314c450e4d667214f3ab7d1408827b95edd_del 2023-03-14 14:55:25,864 INFO [Listener at localhost.localdomain/44261] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='ns:testMinorCompaction' column='family1' 2023-03-14 14:55:25,865 DEBUG [Listener at localhost.localdomain/44261] zookeeper.ReadOnlyZKClient(139): Connect 0x6c1ad31e to 127.0.0.1:50211 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-14 14:55:25,868 DEBUG [Listener at localhost.localdomain/44261] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@a87feef, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-14 14:55:25,870 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230314 for table='ns:testMinorCompaction' and column='family1' 2023-03-14 14:55:25,870 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230314 for table='ns:testMinorCompaction' and column='family1' 2023-03-14 14:55:25,870 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230314 for table='ns:testMinorCompaction' and column='family1' 2023-03-14 14:55:26,296 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230314abbcd297f96b45abbf486089cf1a1180 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230314abbcd297f96b45abbf486089cf1a1180 2023-03-14 14:55:26,297 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230314 table='ns:testMinorCompaction' column='family1' 2023-03-14 14:55:26,310 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-14 14:55:26,312 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:36896, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-14 14:55:26,319 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-14 14:55:26,322 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:56946, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-14 14:55:26,331 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230314/family1/4a2109dfa7df409782fa62a37a0aae73 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x01] 2023-03-14 14:55:26,331 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=ns:testMinorCompaction,1,1678805709571.14e9cbacd99b2cc16b477e8d2c9c88a4., hostname=jenkins-hbase20.apache.org,41317,1678805580877, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230314/family1/4a2109dfa7df409782fa62a37a0aae73}] 2023-03-14 14:55:26,336 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230314/family1/4a2109dfa7df409782fa62a37a0aae73 for inclusion in 14e9cbacd99b2cc16b477e8d2c9c88a4/family1 2023-03-14 14:55:26,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x01 2023-03-14 14:55:26,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(777): Region bounds: first=1 last=2 2023-03-14 14:55:26,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HRegion(2446): Flush status journal for 14e9cbacd99b2cc16b477e8d2c9c88a4: 2023-03-14 14:55:26,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230314/family1/4a2109dfa7df409782fa62a37a0aae73 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__ns_testMinorCompaction__krp4s6oliklgctuv515q9kcqd4o6l3pfn2d6p39s0u1vvh8tkn9fgnqe02i98tm6/family1/4a2109dfa7df409782fa62a37a0aae73 2023-03-14 14:55:26,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__ns_testMinorCompaction__krp4s6oliklgctuv515q9kcqd4o6l3pfn2d6p39s0u1vvh8tkn9fgnqe02i98tm6/family1/4a2109dfa7df409782fa62a37a0aae73 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/family1/497d03530f5346c788f3503927ae62e7_SeqId_28_ 2023-03-14 14:55:26,342 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__ns_testMinorCompaction__krp4s6oliklgctuv515q9kcqd4o6l3pfn2d6p39s0u1vvh8tkn9fgnqe02i98tm6/family1/4a2109dfa7df409782fa62a37a0aae73 into 14e9cbacd99b2cc16b477e8d2c9c88a4/family1 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/family1/497d03530f5346c788f3503927ae62e7_SeqId_28_ - updating store file list. 2023-03-14 14:55:26,344 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/family1/497d03530f5346c788f3503927ae62e7_SeqId_28_ into 14e9cbacd99b2cc16b477e8d2c9c88a4/family1 2023-03-14 14:55:26,344 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__ns_testMinorCompaction__krp4s6oliklgctuv515q9kcqd4o6l3pfn2d6p39s0u1vvh8tkn9fgnqe02i98tm6/family1/4a2109dfa7df409782fa62a37a0aae73 into 14e9cbacd99b2cc16b477e8d2c9c88a4/family1 (new location: hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/family1/497d03530f5346c788f3503927ae62e7_SeqId_28_) 2023-03-14 14:55:26,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__ns_testMinorCompaction__krp4s6oliklgctuv515q9kcqd4o6l3pfn2d6p39s0u1vvh8tkn9fgnqe02i98tm6/family1/4a2109dfa7df409782fa62a37a0aae73 2023-03-14 14:55:26,346 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230314 table='ns:testMinorCompaction' column='family1' 2023-03-14 14:55:26,346 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 14:55:26,347 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023031461a9589fb763498ca372e4cedd3bac30 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023031461a9589fb763498ca372e4cedd3bac30 2023-03-14 14:55:26,347 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-03-14 14:55:26,347 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230314' 2023-03-14 14:55:26,348 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230314 for table='ns:testMinorCompaction' and column='family1' 2023-03-14 14:55:26,699 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023031465310bdb7daa488da0b75be543405b2b to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023031465310bdb7daa488da0b75be543405b2b 2023-03-14 14:55:26,699 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023031470008f7d5d07493e8cd681085050f476 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023031470008f7d5d07493e8cd681085050f476 2023-03-14 14:55:26,700 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230314 table='ns:testMinorCompaction' column='family1' 2023-03-14 14:55:26,700 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230314 table='ns:testMinorCompaction' column='family1' 2023-03-14 14:55:26,726 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230314/family1/00524956d90040ac9d9b770485d55b0b first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x01] 2023-03-14 14:55:26,727 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230314/family1/053c732107f84fa3b84249827a89c1cc first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x01] 2023-03-14 14:55:26,728 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=ns:testMinorCompaction,2,1678805709571.1b57993c9af4fc1b678650e0db6b7634., hostname=jenkins-hbase20.apache.org,41317,1678805580877, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230314/family1/053c732107f84fa3b84249827a89c1cc}] 2023-03-14 14:55:26,728 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=ns:testMinorCompaction,,1678805709571.81d1d1d671b72bf2cfae45402ba07d68., hostname=jenkins-hbase20.apache.org,41317,1678805580877, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230314/family1/00524956d90040ac9d9b770485d55b0b}] 2023-03-14 14:55:26,730 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230314/family1/00524956d90040ac9d9b770485d55b0b for inclusion in 81d1d1d671b72bf2cfae45402ba07d68/family1 2023-03-14 14:55:26,730 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230314/family1/053c732107f84fa3b84249827a89c1cc for inclusion in 1b57993c9af4fc1b678650e0db6b7634/family1 2023-03-14 14:55:26,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x01 2023-03-14 14:55:26,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x01 2023-03-14 14:55:26,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(777): Region bounds: first= last=1 2023-03-14 14:55:26,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HStore(777): Region bounds: first=2 last= 2023-03-14 14:55:26,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HRegion(2446): Flush status journal for 81d1d1d671b72bf2cfae45402ba07d68: 2023-03-14 14:55:26,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HRegion(2446): Flush status journal for 1b57993c9af4fc1b678650e0db6b7634: 2023-03-14 14:55:26,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230314/family1/053c732107f84fa3b84249827a89c1cc to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__ns_testMinorCompaction__s7nket9mnj060ts5mjhrjgiq0fjjnlvohs9050315gdr31pk7a9lohbo8fvd38us/family1/053c732107f84fa3b84249827a89c1cc 2023-03-14 14:55:26,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230314/family1/00524956d90040ac9d9b770485d55b0b to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__ns_testMinorCompaction__fs3hgt0mjh5odkricr6gf6o3j6ospm4va20fo2s8v21bvmpu7go4atj49n5g7h5r/family1/00524956d90040ac9d9b770485d55b0b 2023-03-14 14:55:26,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__ns_testMinorCompaction__s7nket9mnj060ts5mjhrjgiq0fjjnlvohs9050315gdr31pk7a9lohbo8fvd38us/family1/053c732107f84fa3b84249827a89c1cc as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/family1/0aa6fc0d0c394a9999e43694928f0e94_SeqId_28_ 2023-03-14 14:55:26,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__ns_testMinorCompaction__fs3hgt0mjh5odkricr6gf6o3j6ospm4va20fo2s8v21bvmpu7go4atj49n5g7h5r/family1/00524956d90040ac9d9b770485d55b0b as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/family1/8ee1ef63eedc4fbfa98450b5949637f5_SeqId_28_ 2023-03-14 14:55:26,735 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__ns_testMinorCompaction__s7nket9mnj060ts5mjhrjgiq0fjjnlvohs9050315gdr31pk7a9lohbo8fvd38us/family1/053c732107f84fa3b84249827a89c1cc into 1b57993c9af4fc1b678650e0db6b7634/family1 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/family1/0aa6fc0d0c394a9999e43694928f0e94_SeqId_28_ - updating store file list. 2023-03-14 14:55:26,735 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__ns_testMinorCompaction__fs3hgt0mjh5odkricr6gf6o3j6ospm4va20fo2s8v21bvmpu7go4atj49n5g7h5r/family1/00524956d90040ac9d9b770485d55b0b into 81d1d1d671b72bf2cfae45402ba07d68/family1 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/family1/8ee1ef63eedc4fbfa98450b5949637f5_SeqId_28_ - updating store file list. 2023-03-14 14:55:26,737 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/family1/8ee1ef63eedc4fbfa98450b5949637f5_SeqId_28_ into 81d1d1d671b72bf2cfae45402ba07d68/family1 2023-03-14 14:55:26,737 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/family1/0aa6fc0d0c394a9999e43694928f0e94_SeqId_28_ into 1b57993c9af4fc1b678650e0db6b7634/family1 2023-03-14 14:55:26,737 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__ns_testMinorCompaction__s7nket9mnj060ts5mjhrjgiq0fjjnlvohs9050315gdr31pk7a9lohbo8fvd38us/family1/053c732107f84fa3b84249827a89c1cc into 1b57993c9af4fc1b678650e0db6b7634/family1 (new location: hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/family1/0aa6fc0d0c394a9999e43694928f0e94_SeqId_28_) 2023-03-14 14:55:26,737 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__ns_testMinorCompaction__fs3hgt0mjh5odkricr6gf6o3j6ospm4va20fo2s8v21bvmpu7go4atj49n5g7h5r/family1/00524956d90040ac9d9b770485d55b0b into 81d1d1d671b72bf2cfae45402ba07d68/family1 (new location: hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/family1/8ee1ef63eedc4fbfa98450b5949637f5_SeqId_28_) 2023-03-14 14:55:26,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__ns_testMinorCompaction__s7nket9mnj060ts5mjhrjgiq0fjjnlvohs9050315gdr31pk7a9lohbo8fvd38us/family1/053c732107f84fa3b84249827a89c1cc 2023-03-14 14:55:26,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41317] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__ns_testMinorCompaction__fs3hgt0mjh5odkricr6gf6o3j6ospm4va20fo2s8v21bvmpu7go4atj49n5g7h5r/family1/00524956d90040ac9d9b770485d55b0b 2023-03-14 14:55:26,739 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230314 table='ns:testMinorCompaction' column='family1' 2023-03-14 14:55:26,739 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230314 table='ns:testMinorCompaction' column='family1' 2023-03-14 14:55:26,739 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 14:55:26,739 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 14:55:26,740 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202303142c8d4b2901314a56808975a2e9631f55 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202303142c8d4b2901314a56808975a2e9631f55 2023-03-14 14:55:26,740 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202303144fabebc681284895bd5c4a4917770677 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202303144fabebc681284895bd5c4a4917770677 2023-03-14 14:55:26,740 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-03-14 14:55:26,741 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-03-14 14:55:26,741 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230314' 2023-03-14 14:55:26,741 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230314' 2023-03-14 14:55:26,741 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230314 for table='ns:testMinorCompaction' and column='family1' 2023-03-14 14:55:26,741 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230314 for table='ns:testMinorCompaction' and column='family1' 2023-03-14 14:55:26,741 INFO [Listener at localhost.localdomain/44261] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='ns:testMinorCompaction' column='family1' 2023-03-14 14:55:26,743 DEBUG [Listener at localhost.localdomain/44261] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-14 14:55:26,745 DEBUG [Listener at localhost.localdomain/44261] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-14 14:55:26,747 DEBUG [Listener at localhost.localdomain/44261] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-14 14:55:26,747 DEBUG [Listener at localhost.localdomain/44261] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-14 14:55:26,763 INFO [Listener at localhost.localdomain/44261] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompaction Thread=247 (was 285), OpenFileDescriptor=626 (was 761), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=157 (was 124) - SystemLoadAverage LEAK? -, ProcessCount=166 (was 179), AvailableMemoryMB=12223 (was 12240) 2023-03-14 14:55:26,772 INFO [Listener at localhost.localdomain/44261] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=247, OpenFileDescriptor=626, MaxFileDescriptor=60000, SystemLoadAverage=157, ProcessCount=166, AvailableMemoryMB=12223 2023-03-14 14:55:26,774 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-03-14 14:55:26,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:26,776 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-03-14 14:55:26,776 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithMonthlyPolicy" procId is: 112 2023-03-14 14:55:26,777 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-14 14:55:26,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-03-14 14:55:26,778 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816 2023-03-14 14:55:26,778 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816 empty. 2023-03-14 14:55:26,779 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816 2023-03-14 14:55:26,779 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithMonthlyPolicy regions 2023-03-14 14:55:26,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-03-14 14:55:27,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-03-14 14:55:27,188 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-03-14 14:55:27,191 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 67d879ca35c5695ef1b3dd5a65dac816, NAME => 'testMinorCompactionWithMonthlyPolicy,,1678805726774.67d879ca35c5695ef1b3dd5a65dac816.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp 2023-03-14 14:55:27,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-03-14 14:55:27,607 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1678805726774.67d879ca35c5695ef1b3dd5a65dac816.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 14:55:27,607 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing 67d879ca35c5695ef1b3dd5a65dac816, disabling compactions & flushes 2023-03-14 14:55:27,607 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1678805726774.67d879ca35c5695ef1b3dd5a65dac816. 2023-03-14 14:55:27,607 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1678805726774.67d879ca35c5695ef1b3dd5a65dac816. 2023-03-14 14:55:27,607 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1678805726774.67d879ca35c5695ef1b3dd5a65dac816. after waiting 0 ms 2023-03-14 14:55:27,607 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1678805726774.67d879ca35c5695ef1b3dd5a65dac816. 2023-03-14 14:55:27,608 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1678805726774.67d879ca35c5695ef1b3dd5a65dac816. 2023-03-14 14:55:27,608 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 67d879ca35c5695ef1b3dd5a65dac816: 2023-03-14 14:55:27,613 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-03-14 14:55:27,616 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithMonthlyPolicy,,1678805726774.67d879ca35c5695ef1b3dd5a65dac816.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1678805727616"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678805727616"}]},"ts":"1678805727616"} 2023-03-14 14:55:27,617 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-03-14 14:55:27,618 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-14 14:55:27,618 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678805727618"}]},"ts":"1678805727618"} 2023-03-14 14:55:27,619 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-03-14 14:55:27,622 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=67d879ca35c5695ef1b3dd5a65dac816, ASSIGN}] 2023-03-14 14:55:27,624 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=67d879ca35c5695ef1b3dd5a65dac816, ASSIGN 2023-03-14 14:55:27,624 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=67d879ca35c5695ef1b3dd5a65dac816, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,41317,1678805580877; forceNewPlan=false, retain=false 2023-03-14 14:55:27,776 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=67d879ca35c5695ef1b3dd5a65dac816, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:27,776 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithMonthlyPolicy,,1678805726774.67d879ca35c5695ef1b3dd5a65dac816.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1678805727776"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1678805727776"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678805727776"}]},"ts":"1678805727776"} 2023-03-14 14:55:27,780 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=114, ppid=113, state=RUNNABLE; OpenRegionProcedure 67d879ca35c5695ef1b3dd5a65dac816, server=jenkins-hbase20.apache.org,41317,1678805580877}] 2023-03-14 14:55:27,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-03-14 14:55:27,936 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMinorCompactionWithMonthlyPolicy,,1678805726774.67d879ca35c5695ef1b3dd5a65dac816. 2023-03-14 14:55:27,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 67d879ca35c5695ef1b3dd5a65dac816, NAME => 'testMinorCompactionWithMonthlyPolicy,,1678805726774.67d879ca35c5695ef1b3dd5a65dac816.', STARTKEY => '', ENDKEY => ''} 2023-03-14 14:55:27,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithMonthlyPolicy 67d879ca35c5695ef1b3dd5a65dac816 2023-03-14 14:55:27,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1678805726774.67d879ca35c5695ef1b3dd5a65dac816.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 14:55:27,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 67d879ca35c5695ef1b3dd5a65dac816 2023-03-14 14:55:27,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 67d879ca35c5695ef1b3dd5a65dac816 2023-03-14 14:55:27,939 INFO [StoreOpener-67d879ca35c5695ef1b3dd5a65dac816-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 67d879ca35c5695ef1b3dd5a65dac816 2023-03-14 14:55:27,941 DEBUG [StoreOpener-67d879ca35c5695ef1b3dd5a65dac816-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1 2023-03-14 14:55:27,941 DEBUG [StoreOpener-67d879ca35c5695ef1b3dd5a65dac816-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1 2023-03-14 14:55:27,942 INFO [StoreOpener-67d879ca35c5695ef1b3dd5a65dac816-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 67d879ca35c5695ef1b3dd5a65dac816 columnFamilyName family1 2023-03-14 14:55:27,944 INFO [StoreOpener-67d879ca35c5695ef1b3dd5a65dac816-1] regionserver.HStore(310): Store=67d879ca35c5695ef1b3dd5a65dac816/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 14:55:27,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816 2023-03-14 14:55:27,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816 2023-03-14 14:55:27,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 67d879ca35c5695ef1b3dd5a65dac816 2023-03-14 14:55:27,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-14 14:55:27,949 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 67d879ca35c5695ef1b3dd5a65dac816; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70550540, jitterRate=0.051284968852996826}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-03-14 14:55:27,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 67d879ca35c5695ef1b3dd5a65dac816: 2023-03-14 14:55:27,949 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMinorCompactionWithMonthlyPolicy,,1678805726774.67d879ca35c5695ef1b3dd5a65dac816., pid=114, masterSystemTime=1678805727933 2023-03-14 14:55:27,951 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMinorCompactionWithMonthlyPolicy,,1678805726774.67d879ca35c5695ef1b3dd5a65dac816. 2023-03-14 14:55:27,951 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMinorCompactionWithMonthlyPolicy,,1678805726774.67d879ca35c5695ef1b3dd5a65dac816. 2023-03-14 14:55:27,951 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=67d879ca35c5695ef1b3dd5a65dac816, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:27,951 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithMonthlyPolicy,,1678805726774.67d879ca35c5695ef1b3dd5a65dac816.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1678805727951"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1678805727951"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678805727951"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678805727951"}]},"ts":"1678805727951"} 2023-03-14 14:55:27,953 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=114, resume processing ppid=113 2023-03-14 14:55:27,953 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=114, ppid=113, state=SUCCESS; OpenRegionProcedure 67d879ca35c5695ef1b3dd5a65dac816, server=jenkins-hbase20.apache.org,41317,1678805580877 in 173 msec 2023-03-14 14:55:27,954 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=113, resume processing ppid=112 2023-03-14 14:55:27,954 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=113, ppid=112, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=67d879ca35c5695ef1b3dd5a65dac816, ASSIGN in 331 msec 2023-03-14 14:55:27,954 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-14 14:55:27,954 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678805727954"}]},"ts":"1678805727954"} 2023-03-14 14:55:27,955 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-03-14 14:55:27,956 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-03-14 14:55:27,957 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy in 1.1820 sec 2023-03-14 14:55:28,449 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithMonthlyPolicy' 2023-03-14 14:55:28,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-03-14 14:55:28,886 INFO [Listener at localhost.localdomain/44261] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithMonthlyPolicy, procId: 112 completed 2023-03-14 14:55:28,909 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:55:28,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:28,910 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-14 14:55:28,910 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:55:28,910 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-14 14:55:28,910 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-14 14:55:28,911 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:28,911 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:28,912 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:28,912 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:55:28,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:55:28,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:55:28,912 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:28,912 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:55:28,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:28,912 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:28,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:55:28,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:28,913 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:28,913 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:28,913 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-14 14:55:28,913 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:55:28,913 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-14 14:55:28,914 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 14:55:28,914 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:55:28,914 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1678805726774.67d879ca35c5695ef1b3dd5a65dac816. 2023-03-14 14:55:28,914 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1678805726774.67d879ca35c5695ef1b3dd5a65dac816. started... 2023-03-14 14:55:28,915 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 67d879ca35c5695ef1b3dd5a65dac816 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-03-14 14:55:28,931 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511309f33c2f38cda448c8e32e3beb11ec873 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511309f33c2f38cda448c8e32e3beb11ec873 2023-03-14 14:55:28,934 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/.tmp/family1/c3c450f84e434371935e8b6b4805c0ae 2023-03-14 14:55:28,937 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/.tmp/family1/c3c450f84e434371935e8b6b4805c0ae as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/c3c450f84e434371935e8b6b4805c0ae 2023-03-14 14:55:28,940 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/c3c450f84e434371935e8b6b4805c0ae, entries=1000, sequenceid=5, filesize=166.0 K 2023-03-14 14:55:28,941 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 67d879ca35c5695ef1b3dd5a65dac816 in 26ms, sequenceid=5, compaction requested=false 2023-03-14 14:55:28,941 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 67d879ca35c5695ef1b3dd5a65dac816: 2023-03-14 14:55:28,941 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1678805726774.67d879ca35c5695ef1b3dd5a65dac816. 2023-03-14 14:55:28,942 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 14:55:28,942 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 14:55:28,942 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:28,942 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-14 14:55:28,942 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-14 14:55:28,943 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:28,943 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:28,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:28,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:55:28,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:55:28,943 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:28,943 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:55:28,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:55:28,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:55:28,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:28,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:28,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:55:28,944 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-14 14:55:28,944 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4e745918[Count = 0] remaining members to acquire global barrier 2023-03-14 14:55:28,944 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-14 14:55:28,944 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:28,944 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:28,944 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:28,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:28,945 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-14 14:55:28,945 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-14 14:55:28,945 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:55:28,945 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:28,945 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:55:28,945 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-14 14:55:28,945 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:55:28,945 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:28,945 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-14 14:55:28,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:28,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:55:28,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:55:28,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:55:28,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:55:28,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:28,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:28,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:55:28,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:28,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:28,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:55:28,947 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-14 14:55:28,947 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-14 14:55:28,948 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:55:28,948 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:55:28,948 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:28,948 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:55:28,949 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:28,949 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:28,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:28,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:55:28,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:55:28,949 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:28,949 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:55:28,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:28,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:55:28,949 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:28,949 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:55:28,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:55:28,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:28,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:28,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:55:28,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:28,950 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:28,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:28,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:55:28,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:28,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:28,951 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:28,951 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:55:28,951 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:28,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:55:28,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:55:28,951 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:55:28,951 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-14 14:55:28,951 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-14 14:55:28,952 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:55:28,951 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:55:28,951 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:28,952 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:55:28,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:55:28,952 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-14 14:55:28,952 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:28,952 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:55:28,952 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:28,952 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:28,952 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:29,052 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:55:29,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:55:29,058 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:55:29,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-14 14:55:29,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:29,059 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-14 14:55:29,059 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:55:29,059 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-14 14:55:29,059 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-14 14:55:29,060 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:29,060 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:29,061 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:55:29,061 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:29,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:55:29,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:55:29,061 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:29,061 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:55:29,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:29,061 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:29,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:55:29,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:29,062 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:29,062 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-14 14:55:29,062 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:29,062 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-14 14:55:29,062 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:55:29,062 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-14 14:55:29,062 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 14:55:29,062 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:55:29,062 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1678805726774.67d879ca35c5695ef1b3dd5a65dac816. 2023-03-14 14:55:29,062 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1678805726774.67d879ca35c5695ef1b3dd5a65dac816. started... 2023-03-14 14:55:29,062 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 67d879ca35c5695ef1b3dd5a65dac816 1/1 column families, dataSize=74 B heapSize=408 B 2023-03-14 14:55:29,473 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128f593f677022a4627a5fed0c6022129e9 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128f593f677022a4627a5fed0c6022129e9 2023-03-14 14:55:29,878 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/.tmp/family1/b940bd79d8fd4db99588a915aeee9eab 2023-03-14 14:55:29,882 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/.tmp/family1/b940bd79d8fd4db99588a915aeee9eab as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/b940bd79d8fd4db99588a915aeee9eab 2023-03-14 14:55:29,886 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/b940bd79d8fd4db99588a915aeee9eab, entries=1, sequenceid=9, filesize=5.0 K 2023-03-14 14:55:29,887 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 67d879ca35c5695ef1b3dd5a65dac816 in 825ms, sequenceid=9, compaction requested=false 2023-03-14 14:55:29,887 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 67d879ca35c5695ef1b3dd5a65dac816: 2023-03-14 14:55:29,887 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1678805726774.67d879ca35c5695ef1b3dd5a65dac816. 2023-03-14 14:55:29,887 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 14:55:29,887 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 14:55:29,887 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:29,887 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-14 14:55:29,887 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-14 14:55:29,888 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:29,888 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:29,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:29,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:55:29,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:55:29,888 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:29,889 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:55:29,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:55:29,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:55:29,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:29,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:29,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:55:29,889 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-14 14:55:29,890 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7e05f7d6[Count = 0] remaining members to acquire global barrier 2023-03-14 14:55:29,890 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-14 14:55:29,890 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:29,890 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:29,890 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:29,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:29,890 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-14 14:55:29,890 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-14 14:55:29,890 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:55:29,890 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:29,890 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:55:29,891 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-14 14:55:29,891 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:29,891 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:55:29,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:29,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:55:29,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:55:29,891 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-14 14:55:29,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:55:29,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:55:29,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:29,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:29,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:55:29,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:29,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:29,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:55:29,893 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-14 14:55:29,893 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-14 14:55:29,893 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:55:29,893 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:55:29,893 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:29,893 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:55:29,893 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:29,893 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:29,894 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:29,894 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:55:29,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:29,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:29,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:55:29,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:55:29,894 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:55:29,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:55:29,894 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:29,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:55:29,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:29,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:29,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:55:29,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:29,895 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:29,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:29,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:55:29,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:29,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:29,897 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:29,897 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:55:29,897 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:29,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:55:29,897 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:55:29,897 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-14 14:55:29,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:55:29,897 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-14 14:55:29,897 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:55:29,897 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:55:29,897 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:29,897 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:29,897 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:29,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:55:29,897 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:29,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:55:29,897 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-14 14:55:29,897 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:29,897 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:55:29,997 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:55:29,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:55:30,002 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:55:30,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-14 14:55:30,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:30,003 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-14 14:55:30,004 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:55:30,004 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-14 14:55:30,004 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-14 14:55:30,004 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:30,004 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:30,005 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:55:30,005 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:30,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:55:30,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:55:30,005 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:30,005 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:55:30,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:30,006 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:30,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:55:30,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:30,006 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:30,006 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-14 14:55:30,006 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:30,006 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-14 14:55:30,006 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:55:30,006 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-14 14:55:30,006 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 14:55:30,006 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:55:30,006 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1678805726774.67d879ca35c5695ef1b3dd5a65dac816. 2023-03-14 14:55:30,007 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1678805726774.67d879ca35c5695ef1b3dd5a65dac816. started... 2023-03-14 14:55:30,007 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 67d879ca35c5695ef1b3dd5a65dac816 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 14:55:30,418 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120105ed531494f745788229aa61c499399b to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120105ed531494f745788229aa61c499399b 2023-03-14 14:55:30,823 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/.tmp/family1/ade90d885e2345fca74e0863f59f6c75 2023-03-14 14:55:30,827 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/.tmp/family1/ade90d885e2345fca74e0863f59f6c75 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/ade90d885e2345fca74e0863f59f6c75 2023-03-14 14:55:30,831 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/ade90d885e2345fca74e0863f59f6c75, entries=1, sequenceid=13, filesize=4.9 K 2023-03-14 14:55:30,832 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 67d879ca35c5695ef1b3dd5a65dac816 in 825ms, sequenceid=13, compaction requested=true 2023-03-14 14:55:30,832 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 67d879ca35c5695ef1b3dd5a65dac816: 2023-03-14 14:55:30,832 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1678805726774.67d879ca35c5695ef1b3dd5a65dac816. 2023-03-14 14:55:30,832 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 14:55:30,832 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 14:55:30,832 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:30,832 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-14 14:55:30,832 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-14 14:55:30,833 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:30,833 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:30,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:30,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:55:30,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:55:30,833 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:30,833 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:55:30,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:55:30,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:55:30,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:30,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:30,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:55:30,834 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-14 14:55:30,834 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@432c58e6[Count = 0] remaining members to acquire global barrier 2023-03-14 14:55:30,834 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-14 14:55:30,834 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:30,835 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:30,835 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:30,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:30,835 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-14 14:55:30,835 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:30,835 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:55:30,835 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-14 14:55:30,835 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:55:30,836 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-14 14:55:30,836 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:55:30,836 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:30,836 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-14 14:55:30,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:30,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:55:30,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:55:30,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:55:30,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:55:30,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:30,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:30,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:55:30,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:30,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:30,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:55:30,838 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-14 14:55:30,838 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-14 14:55:30,838 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:55:30,838 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:55:30,838 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:30,838 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:55:30,839 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:30,839 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:30,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:30,839 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:55:30,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:30,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:30,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:55:30,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:55:30,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:55:30,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:55:30,840 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:30,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:55:30,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:30,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:30,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:55:30,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:30,840 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:30,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:30,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:55:30,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:30,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:30,842 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:30,842 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:55:30,842 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:30,842 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:55:30,842 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-14 14:55:30,842 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:30,842 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-14 14:55:30,842 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:55:30,842 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:55:30,842 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:55:30,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:55:30,842 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:30,842 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:30,842 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:30,842 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:30,842 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-14 14:55:30,842 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:55:30,842 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:55:30,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:55:30,942 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:55:30,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:55:30,947 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:55:30,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-14 14:55:30,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:30,949 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-14 14:55:30,949 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:55:30,949 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-14 14:55:30,949 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-14 14:55:30,949 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:30,949 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:30,950 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:30,950 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:55:30,950 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:55:30,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:55:30,950 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:30,950 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:55:30,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:30,951 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:30,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:55:30,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:30,951 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:30,951 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-14 14:55:30,951 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:30,951 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-14 14:55:30,952 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:55:30,952 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-14 14:55:30,952 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 14:55:30,952 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:55:30,952 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1678805726774.67d879ca35c5695ef1b3dd5a65dac816. 2023-03-14 14:55:30,952 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1678805726774.67d879ca35c5695ef1b3dd5a65dac816. started... 2023-03-14 14:55:30,952 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 67d879ca35c5695ef1b3dd5a65dac816 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 14:55:31,362 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205ec75cb08d1524a78bfb9f5dc00baf8d9 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151205ec75cb08d1524a78bfb9f5dc00baf8d9 2023-03-14 14:55:31,767 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/.tmp/family1/029463bb6ef4405cbda18f7ab486a218 2023-03-14 14:55:31,771 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/.tmp/family1/029463bb6ef4405cbda18f7ab486a218 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/029463bb6ef4405cbda18f7ab486a218 2023-03-14 14:55:31,775 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/029463bb6ef4405cbda18f7ab486a218, entries=1, sequenceid=17, filesize=4.9 K 2023-03-14 14:55:31,776 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 67d879ca35c5695ef1b3dd5a65dac816 in 824ms, sequenceid=17, compaction requested=true 2023-03-14 14:55:31,776 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 67d879ca35c5695ef1b3dd5a65dac816: 2023-03-14 14:55:31,776 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1678805726774.67d879ca35c5695ef1b3dd5a65dac816. 2023-03-14 14:55:31,776 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 14:55:31,776 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 14:55:31,776 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:31,776 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-14 14:55:31,777 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-14 14:55:31,778 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:31,778 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:31,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:31,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:55:31,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:55:31,778 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:31,778 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:55:31,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:55:31,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:55:31,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:31,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:31,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:55:31,779 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-14 14:55:31,779 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@65bd6a4d[Count = 0] remaining members to acquire global barrier 2023-03-14 14:55:31,779 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-14 14:55:31,779 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:31,779 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:31,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:31,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:31,780 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-14 14:55:31,780 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-14 14:55:31,780 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:31,780 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:55:31,780 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:55:31,780 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:31,780 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-14 14:55:31,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:31,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:55:31,780 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:55:31,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:55:31,780 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-14 14:55:31,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:55:31,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:55:31,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:31,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:31,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:55:31,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:31,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:31,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:55:31,782 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-14 14:55:31,782 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-14 14:55:31,783 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:55:31,783 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:55:31,783 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:31,783 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:55:31,784 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:31,784 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:31,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:31,784 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:55:31,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:31,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:31,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:55:31,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:55:31,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:55:31,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:55:31,784 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:31,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:55:31,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:31,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:31,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:55:31,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:31,785 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:31,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:31,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:55:31,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:31,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:31,786 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:55:31,786 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:55:31,786 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:31,787 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:31,787 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:31,787 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:31,787 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-14 14:55:31,787 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-14 14:55:31,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:55:31,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:55:31,787 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:31,787 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:55:31,787 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:31,787 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:55:31,787 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:31,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:55:31,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:55:31,787 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-14 14:55:31,787 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:55:31,887 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:55:31,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:55:31,893 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:55:31,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-14 14:55:31,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:31,897 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-14 14:55:31,897 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:55:31,897 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-14 14:55:31,897 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-14 14:55:31,898 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:31,898 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:31,899 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:55:31,899 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:31,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:55:31,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:55:31,899 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:31,899 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:55:31,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:31,899 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:31,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:55:31,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:31,900 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:31,902 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-14 14:55:31,903 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:31,903 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-14 14:55:31,903 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:55:31,903 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-14 14:55:31,903 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 14:55:31,903 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:55:31,903 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1678805726774.67d879ca35c5695ef1b3dd5a65dac816. 2023-03-14 14:55:31,903 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1678805726774.67d879ca35c5695ef1b3dd5a65dac816. started... 2023-03-14 14:55:31,903 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 67d879ca35c5695ef1b3dd5a65dac816 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 14:55:31,930 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228122eba43e3324f8582f6537da6b9a108 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228122eba43e3324f8582f6537da6b9a108 2023-03-14 14:55:32,348 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/.tmp/family1/0211ae0716a44a68bef25d5877ebbc6a 2023-03-14 14:55:32,352 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/.tmp/family1/0211ae0716a44a68bef25d5877ebbc6a as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/0211ae0716a44a68bef25d5877ebbc6a 2023-03-14 14:55:32,356 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/0211ae0716a44a68bef25d5877ebbc6a, entries=1, sequenceid=21, filesize=4.9 K 2023-03-14 14:55:32,357 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 67d879ca35c5695ef1b3dd5a65dac816 in 454ms, sequenceid=21, compaction requested=true 2023-03-14 14:55:32,357 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 67d879ca35c5695ef1b3dd5a65dac816: 2023-03-14 14:55:32,357 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1678805726774.67d879ca35c5695ef1b3dd5a65dac816. 2023-03-14 14:55:32,357 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 14:55:32,357 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 14:55:32,357 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:32,357 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-14 14:55:32,357 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-14 14:55:32,358 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:32,358 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:32,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:32,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:55:32,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:55:32,358 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:32,358 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:55:32,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:55:32,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:55:32,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:32,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:32,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:55:32,359 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-14 14:55:32,359 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@96d537b[Count = 0] remaining members to acquire global barrier 2023-03-14 14:55:32,359 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-14 14:55:32,359 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:32,360 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:32,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:32,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:32,360 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-14 14:55:32,360 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-14 14:55:32,360 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:32,360 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:55:32,360 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:55:32,361 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-14 14:55:32,361 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:32,361 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:55:32,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:32,361 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-14 14:55:32,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:55:32,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:55:32,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:55:32,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:55:32,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:32,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:32,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:55:32,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:32,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:32,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:55:32,363 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-14 14:55:32,363 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-14 14:55:32,363 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:55:32,363 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:55:32,363 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:32,363 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:55:32,365 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:32,365 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:55:32,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:32,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:32,365 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:32,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:55:32,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:55:32,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:32,366 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:32,367 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:32,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:32,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:55:32,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:55:32,367 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:55:32,367 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:55:32,367 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:55:32,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:55:32,367 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:55:32,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:55:32,369 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:32,369 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:32,369 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:32,369 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:32,369 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:32,369 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-14 14:55:32,369 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:55:32,369 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:55:32,369 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:32,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:55:32,370 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:32,370 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-14 14:55:32,370 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:55:32,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:55:32,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:55:32,370 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-14 14:55:32,470 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:55:32,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:55:32,474 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:55:32,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-14 14:55:32,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:32,476 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-14 14:55:32,476 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:55:32,476 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-14 14:55:32,476 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-14 14:55:32,476 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:32,476 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:32,477 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:32,477 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:55:32,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:55:32,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:55:32,478 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:32,478 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:55:32,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:32,478 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:32,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:55:32,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:32,478 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:32,478 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-14 14:55:32,479 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:32,479 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-14 14:55:32,479 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:55:32,479 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-14 14:55:32,479 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 14:55:32,479 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:55:32,479 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1678805726774.67d879ca35c5695ef1b3dd5a65dac816. 2023-03-14 14:55:32,479 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1678805726774.67d879ca35c5695ef1b3dd5a65dac816. started... 2023-03-14 14:55:32,479 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 67d879ca35c5695ef1b3dd5a65dac816 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 14:55:32,889 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231e74700ca0a6641598f94a523a6281f9b to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231e74700ca0a6641598f94a523a6281f9b 2023-03-14 14:55:33,293 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/.tmp/family1/1df7baa3fe294c28be390e76ef63a1ed 2023-03-14 14:55:33,297 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/.tmp/family1/1df7baa3fe294c28be390e76ef63a1ed as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/1df7baa3fe294c28be390e76ef63a1ed 2023-03-14 14:55:33,300 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/1df7baa3fe294c28be390e76ef63a1ed, entries=1, sequenceid=25, filesize=4.9 K 2023-03-14 14:55:33,301 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 67d879ca35c5695ef1b3dd5a65dac816 in 822ms, sequenceid=25, compaction requested=true 2023-03-14 14:55:33,301 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 67d879ca35c5695ef1b3dd5a65dac816: 2023-03-14 14:55:33,301 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1678805726774.67d879ca35c5695ef1b3dd5a65dac816. 2023-03-14 14:55:33,301 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 14:55:33,301 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 14:55:33,301 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:33,301 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-14 14:55:33,301 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-14 14:55:33,302 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:33,302 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:33,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:33,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:55:33,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:55:33,303 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:33,303 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:55:33,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:55:33,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:55:33,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:33,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:33,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:55:33,304 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-14 14:55:33,304 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5807bec7[Count = 0] remaining members to acquire global barrier 2023-03-14 14:55:33,304 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-14 14:55:33,304 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:33,304 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:33,304 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:33,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:33,304 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-14 14:55:33,304 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:33,304 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:55:33,304 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-14 14:55:33,304 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:55:33,305 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-14 14:55:33,305 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:55:33,305 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:33,305 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-14 14:55:33,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:33,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:55:33,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:55:33,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:55:33,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:55:33,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:33,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:33,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:55:33,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:33,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:33,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:55:33,307 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-14 14:55:33,307 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-14 14:55:33,307 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:55:33,307 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:55:33,307 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:33,307 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:55:33,308 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:33,308 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:33,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:33,308 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:55:33,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:33,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:33,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:55:33,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:55:33,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:55:33,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:55:33,308 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:33,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:55:33,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:33,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:33,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:55:33,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:33,309 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:33,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:33,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:55:33,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:33,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:33,310 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:33,310 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:55:33,310 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:33,310 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-14 14:55:33,310 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:55:33,310 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:33,310 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-14 14:55:33,310 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:55:33,310 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:55:33,310 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:55:33,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:55:33,310 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:33,310 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-14 14:55:33,311 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:33,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:55:33,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:55:33,311 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:55:33,311 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:33,311 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:33,411 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:55:33,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:55:33,415 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:55:33,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-14 14:55:33,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:33,416 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-14 14:55:33,416 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:55:33,417 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-14 14:55:33,417 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-14 14:55:33,417 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:33,417 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:33,418 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:55:33,418 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:33,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:55:33,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:55:33,418 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:33,418 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:55:33,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:33,418 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:33,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:55:33,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:33,419 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:33,419 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-14 14:55:33,419 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:33,419 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-14 14:55:33,419 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:55:33,419 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-14 14:55:33,419 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 14:55:33,419 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:55:33,419 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1678805726774.67d879ca35c5695ef1b3dd5a65dac816. 2023-03-14 14:55:33,419 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1678805726774.67d879ca35c5695ef1b3dd5a65dac816. started... 2023-03-14 14:55:33,419 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 67d879ca35c5695ef1b3dd5a65dac816 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 14:55:33,479 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-14 14:55:33,832 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101b6532a0b7f604c8ba79eb57d5d1f7d4d to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160101b6532a0b7f604c8ba79eb57d5d1f7d4d 2023-03-14 14:55:34,237 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/.tmp/family1/ef146a459f7a41e5ad356f8ac22e243f 2023-03-14 14:55:34,241 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/.tmp/family1/ef146a459f7a41e5ad356f8ac22e243f as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/ef146a459f7a41e5ad356f8ac22e243f 2023-03-14 14:55:34,244 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/ef146a459f7a41e5ad356f8ac22e243f, entries=1, sequenceid=29, filesize=4.9 K 2023-03-14 14:55:34,245 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 67d879ca35c5695ef1b3dd5a65dac816 in 826ms, sequenceid=29, compaction requested=true 2023-03-14 14:55:34,245 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 67d879ca35c5695ef1b3dd5a65dac816: 2023-03-14 14:55:34,245 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1678805726774.67d879ca35c5695ef1b3dd5a65dac816. 2023-03-14 14:55:34,245 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 14:55:34,245 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 14:55:34,245 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:34,245 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-14 14:55:34,245 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-14 14:55:34,246 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:34,246 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:34,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:34,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:55:34,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:55:34,246 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:34,246 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:55:34,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:55:34,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:55:34,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:34,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:34,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:55:34,247 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-14 14:55:34,248 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@794d3649[Count = 0] remaining members to acquire global barrier 2023-03-14 14:55:34,248 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-14 14:55:34,248 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:34,248 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:34,248 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:34,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:34,248 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-14 14:55:34,248 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-14 14:55:34,248 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:34,248 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:55:34,248 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:55:34,249 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:34,249 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-14 14:55:34,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:34,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:55:34,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:55:34,249 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:55:34,249 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-14 14:55:34,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:55:34,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:55:34,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:34,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:34,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:55:34,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:34,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:34,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:55:34,251 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-14 14:55:34,251 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-14 14:55:34,252 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:55:34,252 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:55:34,252 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:34,252 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:55:34,253 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:34,253 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:55:34,253 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:34,253 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:34,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:34,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:34,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:55:34,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:55:34,253 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:34,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:55:34,254 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:55:34,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:55:34,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:34,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:34,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:55:34,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:34,255 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:34,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:34,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:55:34,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:34,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:34,257 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:34,257 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:55:34,257 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:34,257 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-14 14:55:34,257 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:55:34,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:55:34,257 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:34,257 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:55:34,257 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:55:34,257 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:34,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:55:34,258 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:34,258 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:34,258 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:34,258 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-14 14:55:34,258 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:55:34,258 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:55:34,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:55:34,358 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:55:34,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:55:34,363 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:55:34,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-14 14:55:34,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:34,364 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-14 14:55:34,365 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:55:34,365 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-14 14:55:34,365 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-14 14:55:34,365 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:34,365 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:34,366 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:55:34,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:55:34,366 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:34,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:55:34,366 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:34,366 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:55:34,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:34,367 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:34,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:55:34,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:34,367 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:34,367 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-14 14:55:34,367 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:34,367 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-14 14:55:34,367 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:55:34,367 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-14 14:55:34,368 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 14:55:34,368 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:55:34,368 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1678805726774.67d879ca35c5695ef1b3dd5a65dac816. 2023-03-14 14:55:34,368 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1678805726774.67d879ca35c5695ef1b3dd5a65dac816. started... 2023-03-14 14:55:34,368 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 67d879ca35c5695ef1b3dd5a65dac816 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 14:55:34,785 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103cb0d26d32a804cf1905fe62fc68e17b3 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103cb0d26d32a804cf1905fe62fc68e17b3 2023-03-14 14:55:35,191 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/.tmp/family1/e830e68490e74ebba3dbc9bb93346ad4 2023-03-14 14:55:35,196 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/.tmp/family1/e830e68490e74ebba3dbc9bb93346ad4 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/e830e68490e74ebba3dbc9bb93346ad4 2023-03-14 14:55:35,200 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/e830e68490e74ebba3dbc9bb93346ad4, entries=1, sequenceid=33, filesize=4.9 K 2023-03-14 14:55:35,201 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 67d879ca35c5695ef1b3dd5a65dac816 in 833ms, sequenceid=33, compaction requested=true 2023-03-14 14:55:35,201 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 67d879ca35c5695ef1b3dd5a65dac816: 2023-03-14 14:55:35,201 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1678805726774.67d879ca35c5695ef1b3dd5a65dac816. 2023-03-14 14:55:35,201 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 14:55:35,201 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 14:55:35,201 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:35,201 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-14 14:55:35,201 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-14 14:55:35,202 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:35,202 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:35,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:35,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:55:35,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:55:35,202 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:35,202 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:55:35,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:55:35,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:55:35,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:35,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:35,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:55:35,204 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-14 14:55:35,204 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@77acc42f[Count = 0] remaining members to acquire global barrier 2023-03-14 14:55:35,204 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-14 14:55:35,204 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:35,205 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:35,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:35,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:35,205 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-14 14:55:35,205 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-14 14:55:35,205 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:55:35,205 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:35,205 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:55:35,207 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-14 14:55:35,207 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:35,207 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:55:35,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:35,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:55:35,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:55:35,207 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-14 14:55:35,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:55:35,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:55:35,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:35,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:35,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:55:35,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:35,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:35,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:55:35,209 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-14 14:55:35,209 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-14 14:55:35,209 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:55:35,209 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:55:35,209 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:35,209 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:55:35,209 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:35,209 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:35,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:35,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:55:35,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:55:35,210 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:35,210 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:55:35,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:35,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:55:35,210 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:35,210 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:55:35,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:55:35,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:35,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:35,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:55:35,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:35,211 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:35,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:35,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:55:35,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:35,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:35,212 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:35,212 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:55:35,212 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:35,212 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:55:35,212 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:55:35,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:55:35,212 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:35,212 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-14 14:55:35,212 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-14 14:55:35,212 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:55:35,212 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:55:35,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:55:35,212 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:55:35,212 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:35,212 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:35,212 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:35,212 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:35,212 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-14 14:55:35,213 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:55:35,313 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:55:35,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:55:35,317 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:55:35,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-14 14:55:35,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:35,322 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-14 14:55:35,322 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:55:35,322 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-14 14:55:35,322 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-14 14:55:35,323 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:35,323 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:35,323 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:55:35,323 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:35,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:55:35,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:55:35,324 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:35,324 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:55:35,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:35,324 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:35,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:55:35,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:35,324 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:35,325 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-14 14:55:35,325 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:35,325 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-14 14:55:35,325 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:55:35,325 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-14 14:55:35,325 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 14:55:35,325 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:55:35,325 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1678805726774.67d879ca35c5695ef1b3dd5a65dac816. 2023-03-14 14:55:35,326 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1678805726774.67d879ca35c5695ef1b3dd5a65dac816. started... 2023-03-14 14:55:35,326 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 67d879ca35c5695ef1b3dd5a65dac816 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 14:55:35,739 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509077e4dfdaa5ae94f9fada6afc91f7ef364 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201509077e4dfdaa5ae94f9fada6afc91f7ef364 2023-03-14 14:55:36,147 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/.tmp/family1/4a62e270da0a49138e872787ae0cd1e3 2023-03-14 14:55:36,158 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/.tmp/family1/4a62e270da0a49138e872787ae0cd1e3 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/4a62e270da0a49138e872787ae0cd1e3 2023-03-14 14:55:36,164 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/4a62e270da0a49138e872787ae0cd1e3, entries=1, sequenceid=37, filesize=4.9 K 2023-03-14 14:55:36,165 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 67d879ca35c5695ef1b3dd5a65dac816 in 839ms, sequenceid=37, compaction requested=true 2023-03-14 14:55:36,165 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 67d879ca35c5695ef1b3dd5a65dac816: 2023-03-14 14:55:36,165 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1678805726774.67d879ca35c5695ef1b3dd5a65dac816. 2023-03-14 14:55:36,165 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 14:55:36,165 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 14:55:36,165 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:36,165 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-14 14:55:36,165 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-14 14:55:36,166 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:36,166 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:36,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:36,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:55:36,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:55:36,167 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:36,167 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:55:36,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:55:36,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:55:36,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:36,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:36,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:55:36,169 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-14 14:55:36,169 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@14b9a72a[Count = 0] remaining members to acquire global barrier 2023-03-14 14:55:36,169 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-14 14:55:36,169 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:36,169 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:36,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:36,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:36,169 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-14 14:55:36,170 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-14 14:55:36,170 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:55:36,170 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:36,170 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:55:36,170 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-14 14:55:36,170 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:55:36,170 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:36,170 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-14 14:55:36,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:36,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:55:36,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:55:36,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:55:36,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:55:36,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:36,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:36,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:55:36,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:36,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:36,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:55:36,172 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-14 14:55:36,172 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-14 14:55:36,172 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:55:36,172 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:55:36,172 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:36,172 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:55:36,173 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:36,173 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:36,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:36,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:55:36,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:55:36,173 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:36,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:36,173 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:55:36,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:55:36,174 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:36,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:55:36,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:55:36,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:36,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:36,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:55:36,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:36,174 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:36,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:36,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:55:36,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:36,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:36,175 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:36,175 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:55:36,175 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:36,175 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:55:36,175 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-14 14:55:36,175 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:55:36,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:55:36,175 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-14 14:55:36,176 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:55:36,175 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:55:36,175 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:36,176 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:36,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:55:36,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:55:36,176 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-14 14:55:36,176 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:36,176 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:55:36,176 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:36,176 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:36,276 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:55:36,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:55:36,285 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:55:36,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-03-14 14:55:36,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:36,289 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-03-14 14:55:36,289 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:55:36,289 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-03-14 14:55:36,289 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-03-14 14:55:36,290 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:36,290 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:36,291 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:36,291 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:55:36,291 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:55:36,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:55:36,291 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:36,291 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:55:36,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:36,291 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:36,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:55:36,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:36,292 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:36,292 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-03-14 14:55:36,292 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:36,292 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-03-14 14:55:36,292 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:55:36,292 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-03-14 14:55:36,292 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-03-14 14:55:36,292 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:55:36,292 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1678805726774.67d879ca35c5695ef1b3dd5a65dac816. 2023-03-14 14:55:36,292 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1678805726774.67d879ca35c5695ef1b3dd5a65dac816. started... 2023-03-14 14:55:36,293 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 67d879ca35c5695ef1b3dd5a65dac816 1/1 column families, dataSize=73 B heapSize=408 B 2023-03-14 14:55:36,713 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120d780cc18a88c42eeb05f7cfe9c76dc72 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120d780cc18a88c42eeb05f7cfe9c76dc72 2023-03-14 14:55:37,120 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/.tmp/family1/670b6dbb6d1d4699afc5b97852924aac 2023-03-14 14:55:37,124 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/.tmp/family1/670b6dbb6d1d4699afc5b97852924aac as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/670b6dbb6d1d4699afc5b97852924aac 2023-03-14 14:55:37,128 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/670b6dbb6d1d4699afc5b97852924aac, entries=1, sequenceid=41, filesize=4.9 K 2023-03-14 14:55:37,129 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 67d879ca35c5695ef1b3dd5a65dac816 in 836ms, sequenceid=41, compaction requested=true 2023-03-14 14:55:37,129 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 67d879ca35c5695ef1b3dd5a65dac816: 2023-03-14 14:55:37,129 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1678805726774.67d879ca35c5695ef1b3dd5a65dac816. 2023-03-14 14:55:37,129 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-03-14 14:55:37,129 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-03-14 14:55:37,129 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:37,129 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-03-14 14:55:37,129 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-03-14 14:55:37,130 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:37,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:37,130 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:37,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:55:37,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:55:37,131 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:37,131 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:55:37,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:55:37,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:55:37,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:37,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:37,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:55:37,132 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-03-14 14:55:37,132 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@712dd2fc[Count = 0] remaining members to acquire global barrier 2023-03-14 14:55:37,132 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-03-14 14:55:37,132 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:37,132 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:37,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:37,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:37,133 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-03-14 14:55:37,133 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-03-14 14:55:37,133 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:37,133 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:55:37,133 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:55:37,133 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-03-14 14:55:37,133 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:37,133 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:55:37,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:37,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:55:37,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:55:37,133 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-03-14 14:55:37,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:55:37,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:55:37,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:37,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:37,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:55:37,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:37,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:37,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:55:37,135 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-03-14 14:55:37,135 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-03-14 14:55:37,135 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:55:37,135 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:55:37,135 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:37,135 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:55:37,136 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:37,136 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:37,136 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:37,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:37,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:55:37,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:55:37,136 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:55:37,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:37,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:55:37,136 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:55:37,137 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:37,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:55:37,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:37,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:37,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:55:37,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:37,137 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:37,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:37,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:55:37,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:37,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:37,138 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:37,138 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:55:37,138 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:37,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:55:37,138 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-03-14 14:55:37,138 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:55:37,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:55:37,138 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-03-14 14:55:37,139 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:55:37,138 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:55:37,138 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:37,139 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:37,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:55:37,139 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:37,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:55:37,139 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:37,139 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-03-14 14:55:37,139 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:37,139 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:55:37,239 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:55:37,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:55:37,243 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=38031] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMinorCompactionWithMonthlyPolicy 2023-03-14 14:55:37,244 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] procedure2.ProcedureExecutor(1029): Stored pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-03-14 14:55:37,245 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-03-14 14:55:37,246 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-14 14:55:37,246 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=115, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678806337246 2023-03-14 14:55:37,247 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-03-14 14:55:37,248 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMinorCompactionWithMonthlyPolicy' and column 'family1' 2023-03-14 14:55:37,248 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-14 14:55:37,248 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] zookeeper.ReadOnlyZKClient(139): Connect 0x273fd13e to 127.0.0.1:50211 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-14 14:55:37,253 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@440b4976, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-14 14:55:37,253 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-14 14:55:38,076 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601036095b93a4ba845128ebf3bc9269afd39 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601036095b93a4ba845128ebf3bc9269afd39 2023-03-14 14:55:38,076 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-14 14:55:38,090 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-14 14:55:38,091 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:46392, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-14 14:55:38,096 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-14 14:55:38,097 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:53628, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-14 14:55:38,104 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/67135bb1998547158d4717aa5a8e72ae first=Optional[r5] last=Optional[r6] 2023-03-14 14:55:38,105 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1678805726774.67d879ca35c5695ef1b3dd5a65dac816., hostname=jenkins-hbase20.apache.org,41317,1678805580877, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/67135bb1998547158d4717aa5a8e72ae}] 2023-03-14 14:55:38,110 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/67135bb1998547158d4717aa5a8e72ae for inclusion in 67d879ca35c5695ef1b3dd5a65dac816/family1 2023-03-14 14:55:38,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-03-14 14:55:38,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HStore(777): Region bounds: first= last= 2023-03-14 14:55:38,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HRegion(2446): Flush status journal for 67d879ca35c5695ef1b3dd5a65dac816: 2023-03-14 14:55:38,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/67135bb1998547158d4717aa5a8e72ae to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMinorCompactionWithMonthlyPolicy__jdpggilrako8ebqg1hmvvpu4vomkimd59e8mtbn4bvtscogctklfa62rq3oat2i9/family1/67135bb1998547158d4717aa5a8e72ae 2023-03-14 14:55:38,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMinorCompactionWithMonthlyPolicy__jdpggilrako8ebqg1hmvvpu4vomkimd59e8mtbn4bvtscogctklfa62rq3oat2i9/family1/67135bb1998547158d4717aa5a8e72ae as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/fcdc6d5e814443e0a0d8afdbc0250c80_SeqId_44_ 2023-03-14 14:55:38,116 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMinorCompactionWithMonthlyPolicy__jdpggilrako8ebqg1hmvvpu4vomkimd59e8mtbn4bvtscogctklfa62rq3oat2i9/family1/67135bb1998547158d4717aa5a8e72ae into 67d879ca35c5695ef1b3dd5a65dac816/family1 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/fcdc6d5e814443e0a0d8afdbc0250c80_SeqId_44_ - updating store file list. 2023-03-14 14:55:38,119 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/fcdc6d5e814443e0a0d8afdbc0250c80_SeqId_44_ into 67d879ca35c5695ef1b3dd5a65dac816/family1 2023-03-14 14:55:38,119 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMinorCompactionWithMonthlyPolicy__jdpggilrako8ebqg1hmvvpu4vomkimd59e8mtbn4bvtscogctklfa62rq3oat2i9/family1/67135bb1998547158d4717aa5a8e72ae into 67d879ca35c5695ef1b3dd5a65dac816/family1 (new location: hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/fcdc6d5e814443e0a0d8afdbc0250c80_SeqId_44_) 2023-03-14 14:55:38,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMinorCompactionWithMonthlyPolicy__jdpggilrako8ebqg1hmvvpu4vomkimd59e8mtbn4bvtscogctklfa62rq3oat2i9/family1/67135bb1998547158d4717aa5a8e72ae 2023-03-14 14:55:38,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-03-14 14:55:38,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-03-14 14:55:38,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HStore(1912): 67d879ca35c5695ef1b3dd5a65dac816/family1 is initiating minor compaction 2023-03-14 14:55:38,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@49904df9; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-14 14:55:38,123 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 67d879ca35c5695ef1b3dd5a65dac816/family1 in testMinorCompactionWithMonthlyPolicy,,1678805726774.67d879ca35c5695ef1b3dd5a65dac816. 2023-03-14 14:55:38,123 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/b940bd79d8fd4db99588a915aeee9eab, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/ade90d885e2345fca74e0863f59f6c75, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/029463bb6ef4405cbda18f7ab486a218, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/0211ae0716a44a68bef25d5877ebbc6a, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/1df7baa3fe294c28be390e76ef63a1ed, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/ef146a459f7a41e5ad356f8ac22e243f, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/e830e68490e74ebba3dbc9bb93346ad4, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/4a62e270da0a49138e872787ae0cd1e3, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/670b6dbb6d1d4699afc5b97852924aac, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/fcdc6d5e814443e0a0d8afdbc0250c80_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/.tmp, totalSize=49.7 K 2023-03-14 14:55:38,123 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting b940bd79d8fd4db99588a915aeee9eab, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-03-14 14:55:38,123 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting ade90d885e2345fca74e0863f59f6c75, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-03-14 14:55:38,123 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting 029463bb6ef4405cbda18f7ab486a218, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-03-14 14:55:38,123 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting 0211ae0716a44a68bef25d5877ebbc6a, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-03-14 14:55:38,123 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting 1df7baa3fe294c28be390e76ef63a1ed, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-03-14 14:55:38,123 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting ef146a459f7a41e5ad356f8ac22e243f, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-03-14 14:55:38,123 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting e830e68490e74ebba3dbc9bb93346ad4, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-03-14 14:55:38,123 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting 4a62e270da0a49138e872787ae0cd1e3, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-03-14 14:55:38,123 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting 670b6dbb6d1d4699afc5b97852924aac, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-03-14 14:55:38,123 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting fcdc6d5e814443e0a0d8afdbc0250c80_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-03-14 14:55:38,124 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-14 14:55:38,125 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 14:55:38,127 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160101b6532a0b7f604c8ba79eb57d5d1f7d4d to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160101b6532a0b7f604c8ba79eb57d5d1f7d4d 2023-03-14 14:55:38,128 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103cb0d26d32a804cf1905fe62fc68e17b3 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103cb0d26d32a804cf1905fe62fc68e17b3 2023-03-14 14:55:38,128 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-03-14 14:55:38,128 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-03-14 14:55:38,129 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-14 14:55:38,129 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-14 14:55:38,142 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] throttle.PressureAwareThroughputController(145): 67d879ca35c5695ef1b3dd5a65dac816#family1#compaction#166 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 57.69 MB/second 2023-03-14 14:55:38,561 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231ceeebb1b168d4157b7518f96994eed61 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231ceeebb1b168d4157b7518f96994eed61 2023-03-14 14:55:38,561 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-14 14:55:38,582 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/bf024559261e430592964a0f7d39a8e7 first=Optional[r1] last=Optional[r4] 2023-03-14 14:55:38,583 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1678805726774.67d879ca35c5695ef1b3dd5a65dac816., hostname=jenkins-hbase20.apache.org,41317,1678805580877, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/bf024559261e430592964a0f7d39a8e7}] 2023-03-14 14:55:38,585 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/bf024559261e430592964a0f7d39a8e7 for inclusion in 67d879ca35c5695ef1b3dd5a65dac816/family1 2023-03-14 14:55:38,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-03-14 14:55:38,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HStore(777): Region bounds: first= last= 2023-03-14 14:55:38,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HRegion(2446): Flush status journal for 67d879ca35c5695ef1b3dd5a65dac816: 2023-03-14 14:55:38,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/bf024559261e430592964a0f7d39a8e7 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMinorCompactionWithMonthlyPolicy__kohegfe3cs9q4reva2j9d5hpsbeavnno1p1q9g6ghrluid7toe1gp7ilenv4b3ru/family1/bf024559261e430592964a0f7d39a8e7 2023-03-14 14:55:38,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMinorCompactionWithMonthlyPolicy__kohegfe3cs9q4reva2j9d5hpsbeavnno1p1q9g6ghrluid7toe1gp7ilenv4b3ru/family1/bf024559261e430592964a0f7d39a8e7 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/b07d8ed8b2f246339a45c1664bfb5c36_SeqId_46_ 2023-03-14 14:55:38,590 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMinorCompactionWithMonthlyPolicy__kohegfe3cs9q4reva2j9d5hpsbeavnno1p1q9g6ghrluid7toe1gp7ilenv4b3ru/family1/bf024559261e430592964a0f7d39a8e7 into 67d879ca35c5695ef1b3dd5a65dac816/family1 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/b07d8ed8b2f246339a45c1664bfb5c36_SeqId_46_ - updating store file list. 2023-03-14 14:55:38,594 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/b07d8ed8b2f246339a45c1664bfb5c36_SeqId_46_ into 67d879ca35c5695ef1b3dd5a65dac816/family1 2023-03-14 14:55:38,594 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMinorCompactionWithMonthlyPolicy__kohegfe3cs9q4reva2j9d5hpsbeavnno1p1q9g6ghrluid7toe1gp7ilenv4b3ru/family1/bf024559261e430592964a0f7d39a8e7 into 67d879ca35c5695ef1b3dd5a65dac816/family1 (new location: hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/b07d8ed8b2f246339a45c1664bfb5c36_SeqId_46_) 2023-03-14 14:55:38,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMinorCompactionWithMonthlyPolicy__kohegfe3cs9q4reva2j9d5hpsbeavnno1p1q9g6ghrluid7toe1gp7ilenv4b3ru/family1/bf024559261e430592964a0f7d39a8e7 2023-03-14 14:55:38,596 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-14 14:55:38,597 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 14:55:38,598 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120105ed531494f745788229aa61c499399b to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120105ed531494f745788229aa61c499399b 2023-03-14 14:55:38,599 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151205ec75cb08d1524a78bfb9f5dc00baf8d9 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151205ec75cb08d1524a78bfb9f5dc00baf8d9 2023-03-14 14:55:38,600 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228122eba43e3324f8582f6537da6b9a108 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228122eba43e3324f8582f6537da6b9a108 2023-03-14 14:55:38,600 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231e74700ca0a6641598f94a523a6281f9b to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231e74700ca0a6641598f94a523a6281f9b 2023-03-14 14:55:38,600 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-03-14 14:55:38,600 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-03-14 14:55:38,600 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-14 14:55:38,600 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-14 14:55:38,959 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/.tmp/family1/389bc889fb694b5f9873d030662bb6d5 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/389bc889fb694b5f9873d030662bb6d5 2023-03-14 14:55:38,964 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 67d879ca35c5695ef1b3dd5a65dac816/family1 of 67d879ca35c5695ef1b3dd5a65dac816 into 389bc889fb694b5f9873d030662bb6d5(size=6.6 K), total size for store is 178.1 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-14 14:55:38,964 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 67d879ca35c5695ef1b3dd5a65dac816: 2023-03-14 14:55:38,964 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1678805726774.67d879ca35c5695ef1b3dd5a65dac816., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1678805738122; duration=0sec 2023-03-14 14:55:38,964 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-14 14:55:39,033 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/b940bd79d8fd4db99588a915aeee9eab, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/ade90d885e2345fca74e0863f59f6c75, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/029463bb6ef4405cbda18f7ab486a218, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/0211ae0716a44a68bef25d5877ebbc6a, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/1df7baa3fe294c28be390e76ef63a1ed, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/ef146a459f7a41e5ad356f8ac22e243f, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/e830e68490e74ebba3dbc9bb93346ad4, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/4a62e270da0a49138e872787ae0cd1e3, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/670b6dbb6d1d4699afc5b97852924aac, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/fcdc6d5e814443e0a0d8afdbc0250c80_SeqId_44_] to archive 2023-03-14 14:55:39,034 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 14:55:39,035 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/b940bd79d8fd4db99588a915aeee9eab to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/b940bd79d8fd4db99588a915aeee9eab 2023-03-14 14:55:39,036 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/ade90d885e2345fca74e0863f59f6c75 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/ade90d885e2345fca74e0863f59f6c75 2023-03-14 14:55:39,036 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/029463bb6ef4405cbda18f7ab486a218 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/029463bb6ef4405cbda18f7ab486a218 2023-03-14 14:55:39,037 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/0211ae0716a44a68bef25d5877ebbc6a to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/0211ae0716a44a68bef25d5877ebbc6a 2023-03-14 14:55:39,038 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/1df7baa3fe294c28be390e76ef63a1ed to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/1df7baa3fe294c28be390e76ef63a1ed 2023-03-14 14:55:39,039 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/ef146a459f7a41e5ad356f8ac22e243f to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/ef146a459f7a41e5ad356f8ac22e243f 2023-03-14 14:55:39,040 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/e830e68490e74ebba3dbc9bb93346ad4 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/e830e68490e74ebba3dbc9bb93346ad4 2023-03-14 14:55:39,041 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/4a62e270da0a49138e872787ae0cd1e3 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/4a62e270da0a49138e872787ae0cd1e3 2023-03-14 14:55:39,041 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/670b6dbb6d1d4699afc5b97852924aac to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/670b6dbb6d1d4699afc5b97852924aac 2023-03-14 14:55:39,042 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/fcdc6d5e814443e0a0d8afdbc0250c80_SeqId_44_ to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/fcdc6d5e814443e0a0d8afdbc0250c80_SeqId_44_ 2023-03-14 14:55:39,425 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130cd881fccbb71474583af285339a6850a to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130cd881fccbb71474583af285339a6850a 2023-03-14 14:55:39,426 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-14 14:55:39,449 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/7707bc9a6d2c48a7aa741bbb066d750b first=Optional[r00] last=Optional[r8] 2023-03-14 14:55:39,450 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1678805726774.67d879ca35c5695ef1b3dd5a65dac816., hostname=jenkins-hbase20.apache.org,41317,1678805580877, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/7707bc9a6d2c48a7aa741bbb066d750b}] 2023-03-14 14:55:39,452 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/7707bc9a6d2c48a7aa741bbb066d750b for inclusion in 67d879ca35c5695ef1b3dd5a65dac816/family1 2023-03-14 14:55:39,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-03-14 14:55:39,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HStore(777): Region bounds: first= last= 2023-03-14 14:55:39,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HRegion(2446): Flush status journal for 67d879ca35c5695ef1b3dd5a65dac816: 2023-03-14 14:55:39,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/7707bc9a6d2c48a7aa741bbb066d750b to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMinorCompactionWithMonthlyPolicy__beq2s5v1utq1c5j57avglk21uj47scevcs69t4k5cvp5jofcbnk0ei2umt0klv2e/family1/7707bc9a6d2c48a7aa741bbb066d750b 2023-03-14 14:55:39,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMinorCompactionWithMonthlyPolicy__beq2s5v1utq1c5j57avglk21uj47scevcs69t4k5cvp5jofcbnk0ei2umt0klv2e/family1/7707bc9a6d2c48a7aa741bbb066d750b as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/e017102079dc40d490ca2c980038e523_SeqId_49_ 2023-03-14 14:55:39,457 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMinorCompactionWithMonthlyPolicy__beq2s5v1utq1c5j57avglk21uj47scevcs69t4k5cvp5jofcbnk0ei2umt0klv2e/family1/7707bc9a6d2c48a7aa741bbb066d750b into 67d879ca35c5695ef1b3dd5a65dac816/family1 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/e017102079dc40d490ca2c980038e523_SeqId_49_ - updating store file list. 2023-03-14 14:55:39,460 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/e017102079dc40d490ca2c980038e523_SeqId_49_ into 67d879ca35c5695ef1b3dd5a65dac816/family1 2023-03-14 14:55:39,461 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMinorCompactionWithMonthlyPolicy__beq2s5v1utq1c5j57avglk21uj47scevcs69t4k5cvp5jofcbnk0ei2umt0klv2e/family1/7707bc9a6d2c48a7aa741bbb066d750b into 67d879ca35c5695ef1b3dd5a65dac816/family1 (new location: hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/e017102079dc40d490ca2c980038e523_SeqId_49_) 2023-03-14 14:55:39,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMinorCompactionWithMonthlyPolicy__beq2s5v1utq1c5j57avglk21uj47scevcs69t4k5cvp5jofcbnk0ei2umt0klv2e/family1/7707bc9a6d2c48a7aa741bbb066d750b 2023-03-14 14:55:39,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-03-14 14:55:39,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 352581 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-03-14 14:55:39,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HStore(1912): 67d879ca35c5695ef1b3dd5a65dac816/family1 is initiating minor compaction (all files) 2023-03-14 14:55:39,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@2585841c; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-14 14:55:39,463 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 67d879ca35c5695ef1b3dd5a65dac816/family1 in testMinorCompactionWithMonthlyPolicy,,1678805726774.67d879ca35c5695ef1b3dd5a65dac816. 2023-03-14 14:55:39,463 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/c3c450f84e434371935e8b6b4805c0ae, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/389bc889fb694b5f9873d030662bb6d5, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/b07d8ed8b2f246339a45c1664bfb5c36_SeqId_46_, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/e017102079dc40d490ca2c980038e523_SeqId_49_] into tmpdir=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/.tmp, totalSize=344.3 K 2023-03-14 14:55:39,463 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting c3c450f84e434371935e8b6b4805c0ae, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878806007 2023-03-14 14:55:39,464 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting 389bc889fb694b5f9873d030662bb6d5, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621206007 2023-03-14 14:55:39,464 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting b07d8ed8b2f246339a45c1664bfb5c36_SeqId_46_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=47, earliestPutTs=1448965206007 2023-03-14 14:55:39,464 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] compactions.Compactor(207): Compacting e017102079dc40d490ca2c980038e523_SeqId_49_, keycount=1001, bloomtype=ROW, size=166.2 K, encoding=NONE, compression=NONE, seqNum=50, earliestPutTs=1448014806007 2023-03-14 14:55:39,464 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-14 14:55:39,465 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 14:55:39,466 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120d780cc18a88c42eeb05f7cfe9c76dc72 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120d780cc18a88c42eeb05f7cfe9c76dc72 2023-03-14 14:55:39,466 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128f593f677022a4627a5fed0c6022129e9 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128f593f677022a4627a5fed0c6022129e9 2023-03-14 14:55:39,467 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511309f33c2f38cda448c8e32e3beb11ec873 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511309f33c2f38cda448c8e32e3beb11ec873 2023-03-14 14:55:39,467 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-03-14 14:55:39,467 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-03-14 14:55:39,468 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-14 14:55:39,468 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-14 14:55:39,468 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-03-14 14:55:39,468 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-03-14 14:55:39,468 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-14 14:55:39,470 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=115, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-03-14 14:55:39,471 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=115, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 2.2260 sec 2023-03-14 14:55:39,481 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] throttle.PressureAwareThroughputController(145): 67d879ca35c5695ef1b3dd5a65dac816#family1#compaction#167 average throughput is 22.23 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 57.69 MB/second 2023-03-14 14:55:39,682 INFO [Listener at localhost.localdomain/44261] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=253 (was 247) - Thread LEAK? -, OpenFileDescriptor=641 (was 626) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=145 (was 157), ProcessCount=166 (was 166), AvailableMemoryMB=13873 (was 12223) - AvailableMemoryMB LEAK? - 2023-03-14 14:55:39,693 INFO [Listener at localhost.localdomain/44261] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=253, OpenFileDescriptor=641, MaxFileDescriptor=60000, SystemLoadAverage=145, ProcessCount=166, AvailableMemoryMB=13870 2023-03-14 14:55:39,711 DEBUG [Listener at localhost.localdomain/44261] crypto.Encryption(565): Installed org.apache.hadoop.hbase.io.crypto.KeyProviderForTesting into key provider cache 2023-03-14 14:55:39,764 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xE5\xE8\xA7\xCD\xF5\xB9;\xC6eV&\x923\x89;\xF1"\x10\xD0=0C{\xB8*\xF6\xB8\xA7W\x0D\x91%M\x9B*\x10\xE8\x1E\xA0x+\x84\xAD!\x97O\xA2\xC5\xAAS\x01#2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-03-14 14:55:39,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure2.ProcedureExecutor(1029): Stored pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionFromAdmin 2023-03-14 14:55:39,767 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_PRE_OPERATION 2023-03-14 14:55:39,767 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionFromAdmin" procId is: 116 2023-03-14 14:55:39,767 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-03-14 14:55:39,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-03-14 14:55:39,769 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198 2023-03-14 14:55:39,769 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28 2023-03-14 14:55:39,769 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4 2023-03-14 14:55:39,769 DEBUG [HFileArchiver-21] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28 empty. 2023-03-14 14:55:39,769 DEBUG [HFileArchiver-22] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4 empty. 2023-03-14 14:55:39,769 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198 empty. 2023-03-14 14:55:39,769 DEBUG [HFileArchiver-21] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28 2023-03-14 14:55:39,769 DEBUG [HFileArchiver-22] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4 2023-03-14 14:55:39,769 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198 2023-03-14 14:55:39,769 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMajorCompactionFromAdmin regions 2023-03-14 14:55:39,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-03-14 14:55:39,913 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/.tmp/family1/db6d7a3eebaf41cabe7bedbe0d93f13e as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/db6d7a3eebaf41cabe7bedbe0d93f13e 2023-03-14 14:55:39,917 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 67d879ca35c5695ef1b3dd5a65dac816/family1 of 67d879ca35c5695ef1b3dd5a65dac816 into db6d7a3eebaf41cabe7bedbe0d93f13e(size=167.4 K), total size for store is 167.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-14 14:55:39,917 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 67d879ca35c5695ef1b3dd5a65dac816: 2023-03-14 14:55:39,917 INFO [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1678805726774.67d879ca35c5695ef1b3dd5a65dac816., storeName=family1, fileCount=4, fileSize=344.3 K (166.0 K, 6.6 K, 5.5 K, 166.2 K), priority=2, time=1678805739463; duration=0sec 2023-03-14 14:55:39,917 DEBUG [RS:0;jenkins-hbase20:41317-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-03-14 14:55:39,935 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/c3c450f84e434371935e8b6b4805c0ae, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/389bc889fb694b5f9873d030662bb6d5, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/b07d8ed8b2f246339a45c1664bfb5c36_SeqId_46_, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/e017102079dc40d490ca2c980038e523_SeqId_49_] to archive 2023-03-14 14:55:39,935 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 14:55:39,937 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/c3c450f84e434371935e8b6b4805c0ae to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/c3c450f84e434371935e8b6b4805c0ae 2023-03-14 14:55:39,938 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/389bc889fb694b5f9873d030662bb6d5 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/389bc889fb694b5f9873d030662bb6d5 2023-03-14 14:55:39,939 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/b07d8ed8b2f246339a45c1664bfb5c36_SeqId_46_ to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/b07d8ed8b2f246339a45c1664bfb5c36_SeqId_46_ 2023-03-14 14:55:39,940 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/e017102079dc40d490ca2c980038e523_SeqId_49_ to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/family1/e017102079dc40d490ca2c980038e523_SeqId_49_ 2023-03-14 14:55:40,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-03-14 14:55:40,176 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp/data/default/testMajorCompactionFromAdmin/.tabledesc/.tableinfo.0000000001 2023-03-14 14:55:40,177 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(7675): creating {ENCODED => 82c61abd947e5b78a8c268e9c5cab198, NAME => 'testMajorCompactionFromAdmin,,1678805739734.82c61abd947e5b78a8c268e9c5cab198.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xE5\xE8\xA7\xCD\xF5\xB9;\xC6eV&\x923\x89;\xF1"\x10\xD0=0C{\xB8*\xF6\xB8\xA7W\x0D\x91%M\x9B*\x10\xE8\x1E\xA0x+\x84\xAD!\x97O\xA2\xC5\xAAS\x01#2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp 2023-03-14 14:55:40,177 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(7675): creating {ENCODED => 8816b1e503374db245dbd0800d77f3a4, NAME => 'testMajorCompactionFromAdmin,2,1678805739734.8816b1e503374db245dbd0800d77f3a4.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xE5\xE8\xA7\xCD\xF5\xB9;\xC6eV&\x923\x89;\xF1"\x10\xD0=0C{\xB8*\xF6\xB8\xA7W\x0D\x91%M\x9B*\x10\xE8\x1E\xA0x+\x84\xAD!\x97O\xA2\xC5\xAAS\x01#2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp 2023-03-14 14:55:40,177 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(7675): creating {ENCODED => cfc8b82e17760331b0d59f661140bb28, NAME => 'testMajorCompactionFromAdmin,1,1678805739734.cfc8b82e17760331b0d59f661140bb28.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xE5\xE8\xA7\xCD\xF5\xB9;\xC6eV&\x923\x89;\xF1"\x10\xD0=0C{\xB8*\xF6\xB8\xA7W\x0D\x91%M\x9B*\x10\xE8\x1E\xA0x+\x84\xAD!\x97O\xA2\xC5\xAAS\x01#2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/.tmp 2023-03-14 14:55:40,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-03-14 14:55:40,588 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1678805739734.cfc8b82e17760331b0d59f661140bb28.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 14:55:40,588 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1678805739734.8816b1e503374db245dbd0800d77f3a4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 14:55:40,588 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1678805739734.82c61abd947e5b78a8c268e9c5cab198.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 14:55:40,588 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1604): Closing 8816b1e503374db245dbd0800d77f3a4, disabling compactions & flushes 2023-03-14 14:55:40,588 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1604): Closing 82c61abd947e5b78a8c268e9c5cab198, disabling compactions & flushes 2023-03-14 14:55:40,588 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1604): Closing cfc8b82e17760331b0d59f661140bb28, disabling compactions & flushes 2023-03-14 14:55:40,588 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1678805739734.82c61abd947e5b78a8c268e9c5cab198. 2023-03-14 14:55:40,588 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1678805739734.82c61abd947e5b78a8c268e9c5cab198. 2023-03-14 14:55:40,588 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1678805739734.8816b1e503374db245dbd0800d77f3a4. 2023-03-14 14:55:40,588 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1678805739734.82c61abd947e5b78a8c268e9c5cab198. after waiting 0 ms 2023-03-14 14:55:40,588 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1678805739734.cfc8b82e17760331b0d59f661140bb28. 2023-03-14 14:55:40,589 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1678805739734.82c61abd947e5b78a8c268e9c5cab198. 2023-03-14 14:55:40,588 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1678805739734.8816b1e503374db245dbd0800d77f3a4. 2023-03-14 14:55:40,589 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1678805739734.82c61abd947e5b78a8c268e9c5cab198. 2023-03-14 14:55:40,589 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1678805739734.cfc8b82e17760331b0d59f661140bb28. 2023-03-14 14:55:40,589 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1558): Region close journal for 82c61abd947e5b78a8c268e9c5cab198: 2023-03-14 14:55:40,589 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1678805739734.8816b1e503374db245dbd0800d77f3a4. after waiting 0 ms 2023-03-14 14:55:40,589 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1678805739734.cfc8b82e17760331b0d59f661140bb28. after waiting 0 ms 2023-03-14 14:55:40,589 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1678805739734.8816b1e503374db245dbd0800d77f3a4. 2023-03-14 14:55:40,589 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1678805739734.cfc8b82e17760331b0d59f661140bb28. 2023-03-14 14:55:40,589 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1678805739734.8816b1e503374db245dbd0800d77f3a4. 2023-03-14 14:55:40,589 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1678805739734.cfc8b82e17760331b0d59f661140bb28. 2023-03-14 14:55:40,589 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1558): Region close journal for 8816b1e503374db245dbd0800d77f3a4: 2023-03-14 14:55:40,589 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1558): Region close journal for cfc8b82e17760331b0d59f661140bb28: 2023-03-14 14:55:40,591 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ADD_TO_META 2023-03-14 14:55:40,592 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,,1678805739734.82c61abd947e5b78a8c268e9c5cab198.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678805740592"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678805740592"}]},"ts":"1678805740592"} 2023-03-14 14:55:40,592 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,2,1678805739734.8816b1e503374db245dbd0800d77f3a4.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678805740592"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678805740592"}]},"ts":"1678805740592"} 2023-03-14 14:55:40,592 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,1,1678805739734.cfc8b82e17760331b0d59f661140bb28.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1678805740592"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1678805740592"}]},"ts":"1678805740592"} 2023-03-14 14:55:40,594 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-03-14 14:55:40,594 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-03-14 14:55:40,595 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678805740595"}]},"ts":"1678805740595"} 2023-03-14 14:55:40,596 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLING in hbase:meta 2023-03-14 14:55:40,597 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=82c61abd947e5b78a8c268e9c5cab198, ASSIGN}, {pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=cfc8b82e17760331b0d59f661140bb28, ASSIGN}, {pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=8816b1e503374db245dbd0800d77f3a4, ASSIGN}] 2023-03-14 14:55:40,599 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=8816b1e503374db245dbd0800d77f3a4, ASSIGN 2023-03-14 14:55:40,599 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=82c61abd947e5b78a8c268e9c5cab198, ASSIGN 2023-03-14 14:55:40,599 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=cfc8b82e17760331b0d59f661140bb28, ASSIGN 2023-03-14 14:55:40,600 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=8816b1e503374db245dbd0800d77f3a4, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,41317,1678805580877; forceNewPlan=false, retain=false 2023-03-14 14:55:40,600 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=82c61abd947e5b78a8c268e9c5cab198, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,41317,1678805580877; forceNewPlan=false, retain=false 2023-03-14 14:55:40,600 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=cfc8b82e17760331b0d59f661140bb28, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,41317,1678805580877; forceNewPlan=false, retain=false 2023-03-14 14:55:40,752 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=cfc8b82e17760331b0d59f661140bb28, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:40,752 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=82c61abd947e5b78a8c268e9c5cab198, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:40,752 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=8816b1e503374db245dbd0800d77f3a4, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:40,752 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,,1678805739734.82c61abd947e5b78a8c268e9c5cab198.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678805740752"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1678805740752"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678805740752"}]},"ts":"1678805740752"} 2023-03-14 14:55:40,752 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,2,1678805739734.8816b1e503374db245dbd0800d77f3a4.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678805740752"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1678805740752"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678805740752"}]},"ts":"1678805740752"} 2023-03-14 14:55:40,752 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,1,1678805739734.cfc8b82e17760331b0d59f661140bb28.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1678805740752"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1678805740752"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1678805740752"}]},"ts":"1678805740752"} 2023-03-14 14:55:40,753 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=120, ppid=117, state=RUNNABLE; OpenRegionProcedure 82c61abd947e5b78a8c268e9c5cab198, server=jenkins-hbase20.apache.org,41317,1678805580877}] 2023-03-14 14:55:40,754 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=121, ppid=119, state=RUNNABLE; OpenRegionProcedure 8816b1e503374db245dbd0800d77f3a4, server=jenkins-hbase20.apache.org,41317,1678805580877}] 2023-03-14 14:55:40,754 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=122, ppid=118, state=RUNNABLE; OpenRegionProcedure cfc8b82e17760331b0d59f661140bb28, server=jenkins-hbase20.apache.org,41317,1678805580877}] 2023-03-14 14:55:40,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-03-14 14:55:40,907 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,,1678805739734.82c61abd947e5b78a8c268e9c5cab198. 2023-03-14 14:55:40,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 82c61abd947e5b78a8c268e9c5cab198, NAME => 'testMajorCompactionFromAdmin,,1678805739734.82c61abd947e5b78a8c268e9c5cab198.', STARTKEY => '', ENDKEY => '1'} 2023-03-14 14:55:40,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 82c61abd947e5b78a8c268e9c5cab198 2023-03-14 14:55:40,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1678805739734.82c61abd947e5b78a8c268e9c5cab198.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 14:55:40,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 82c61abd947e5b78a8c268e9c5cab198 2023-03-14 14:55:40,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 82c61abd947e5b78a8c268e9c5cab198 2023-03-14 14:55:40,925 INFO [StoreOpener-82c61abd947e5b78a8c268e9c5cab198-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 82c61abd947e5b78a8c268e9c5cab198 2023-03-14 14:55:40,927 DEBUG [StoreOpener-82c61abd947e5b78a8c268e9c5cab198-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/family1 2023-03-14 14:55:40,927 DEBUG [StoreOpener-82c61abd947e5b78a8c268e9c5cab198-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/family1 2023-03-14 14:55:40,927 INFO [StoreOpener-82c61abd947e5b78a8c268e9c5cab198-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 82c61abd947e5b78a8c268e9c5cab198 columnFamilyName family1 2023-03-14 14:55:40,928 INFO [StoreOpener-82c61abd947e5b78a8c268e9c5cab198-1] regionserver.HStore(310): Store=82c61abd947e5b78a8c268e9c5cab198/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 14:55:40,928 INFO [StoreOpener-82c61abd947e5b78a8c268e9c5cab198-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 82c61abd947e5b78a8c268e9c5cab198 2023-03-14 14:55:40,929 DEBUG [StoreOpener-82c61abd947e5b78a8c268e9c5cab198-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/family2 2023-03-14 14:55:40,930 DEBUG [StoreOpener-82c61abd947e5b78a8c268e9c5cab198-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/family2 2023-03-14 14:55:40,930 INFO [StoreOpener-82c61abd947e5b78a8c268e9c5cab198-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 82c61abd947e5b78a8c268e9c5cab198 columnFamilyName family2 2023-03-14 14:55:40,931 INFO [StoreOpener-82c61abd947e5b78a8c268e9c5cab198-1] regionserver.HStore(310): Store=82c61abd947e5b78a8c268e9c5cab198/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 14:55:40,932 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198 2023-03-14 14:55:40,932 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198 2023-03-14 14:55:40,933 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-14 14:55:40,934 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 82c61abd947e5b78a8c268e9c5cab198 2023-03-14 14:55:40,935 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-14 14:55:40,935 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 82c61abd947e5b78a8c268e9c5cab198; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60310981, jitterRate=-0.10129635035991669}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-14 14:55:40,935 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 82c61abd947e5b78a8c268e9c5cab198: 2023-03-14 14:55:40,936 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,,1678805739734.82c61abd947e5b78a8c268e9c5cab198., pid=120, masterSystemTime=1678805740905 2023-03-14 14:55:40,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,,1678805739734.82c61abd947e5b78a8c268e9c5cab198. 2023-03-14 14:55:40,937 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,,1678805739734.82c61abd947e5b78a8c268e9c5cab198. 2023-03-14 14:55:40,937 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,2,1678805739734.8816b1e503374db245dbd0800d77f3a4. 2023-03-14 14:55:40,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8816b1e503374db245dbd0800d77f3a4, NAME => 'testMajorCompactionFromAdmin,2,1678805739734.8816b1e503374db245dbd0800d77f3a4.', STARTKEY => '2', ENDKEY => ''} 2023-03-14 14:55:40,937 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=82c61abd947e5b78a8c268e9c5cab198, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:40,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 8816b1e503374db245dbd0800d77f3a4 2023-03-14 14:55:40,937 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,,1678805739734.82c61abd947e5b78a8c268e9c5cab198.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678805740937"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1678805740937"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678805740937"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678805740937"}]},"ts":"1678805740937"} 2023-03-14 14:55:40,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1678805739734.8816b1e503374db245dbd0800d77f3a4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 14:55:40,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 8816b1e503374db245dbd0800d77f3a4 2023-03-14 14:55:40,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 8816b1e503374db245dbd0800d77f3a4 2023-03-14 14:55:40,939 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=120, resume processing ppid=117 2023-03-14 14:55:40,940 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=120, ppid=117, state=SUCCESS; OpenRegionProcedure 82c61abd947e5b78a8c268e9c5cab198, server=jenkins-hbase20.apache.org,41317,1678805580877 in 185 msec 2023-03-14 14:55:40,940 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=82c61abd947e5b78a8c268e9c5cab198, ASSIGN in 342 msec 2023-03-14 14:55:40,955 INFO [StoreOpener-8816b1e503374db245dbd0800d77f3a4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 8816b1e503374db245dbd0800d77f3a4 2023-03-14 14:55:40,956 DEBUG [StoreOpener-8816b1e503374db245dbd0800d77f3a4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/family1 2023-03-14 14:55:40,956 DEBUG [StoreOpener-8816b1e503374db245dbd0800d77f3a4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/family1 2023-03-14 14:55:40,957 INFO [StoreOpener-8816b1e503374db245dbd0800d77f3a4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8816b1e503374db245dbd0800d77f3a4 columnFamilyName family1 2023-03-14 14:55:40,957 INFO [StoreOpener-8816b1e503374db245dbd0800d77f3a4-1] regionserver.HStore(310): Store=8816b1e503374db245dbd0800d77f3a4/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 14:55:40,958 INFO [StoreOpener-8816b1e503374db245dbd0800d77f3a4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 8816b1e503374db245dbd0800d77f3a4 2023-03-14 14:55:40,958 DEBUG [StoreOpener-8816b1e503374db245dbd0800d77f3a4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/family2 2023-03-14 14:55:40,958 DEBUG [StoreOpener-8816b1e503374db245dbd0800d77f3a4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/family2 2023-03-14 14:55:40,959 INFO [StoreOpener-8816b1e503374db245dbd0800d77f3a4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8816b1e503374db245dbd0800d77f3a4 columnFamilyName family2 2023-03-14 14:55:40,959 INFO [StoreOpener-8816b1e503374db245dbd0800d77f3a4-1] regionserver.HStore(310): Store=8816b1e503374db245dbd0800d77f3a4/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 14:55:40,960 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4 2023-03-14 14:55:40,960 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4 2023-03-14 14:55:40,961 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-14 14:55:40,962 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 8816b1e503374db245dbd0800d77f3a4 2023-03-14 14:55:40,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-14 14:55:40,963 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 8816b1e503374db245dbd0800d77f3a4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69465604, jitterRate=0.035118162631988525}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-14 14:55:40,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 8816b1e503374db245dbd0800d77f3a4: 2023-03-14 14:55:40,964 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,2,1678805739734.8816b1e503374db245dbd0800d77f3a4., pid=121, masterSystemTime=1678805740905 2023-03-14 14:55:40,965 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,2,1678805739734.8816b1e503374db245dbd0800d77f3a4. 2023-03-14 14:55:40,965 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,2,1678805739734.8816b1e503374db245dbd0800d77f3a4. 2023-03-14 14:55:40,965 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,1,1678805739734.cfc8b82e17760331b0d59f661140bb28. 2023-03-14 14:55:40,965 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cfc8b82e17760331b0d59f661140bb28, NAME => 'testMajorCompactionFromAdmin,1,1678805739734.cfc8b82e17760331b0d59f661140bb28.', STARTKEY => '1', ENDKEY => '2'} 2023-03-14 14:55:40,965 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=8816b1e503374db245dbd0800d77f3a4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:40,965 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin cfc8b82e17760331b0d59f661140bb28 2023-03-14 14:55:40,966 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,2,1678805739734.8816b1e503374db245dbd0800d77f3a4.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1678805740965"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1678805740965"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678805740965"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678805740965"}]},"ts":"1678805740965"} 2023-03-14 14:55:40,966 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1678805739734.cfc8b82e17760331b0d59f661140bb28.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-03-14 14:55:40,966 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for cfc8b82e17760331b0d59f661140bb28 2023-03-14 14:55:40,966 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for cfc8b82e17760331b0d59f661140bb28 2023-03-14 14:55:40,968 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=121, resume processing ppid=119 2023-03-14 14:55:40,968 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=121, ppid=119, state=SUCCESS; OpenRegionProcedure 8816b1e503374db245dbd0800d77f3a4, server=jenkins-hbase20.apache.org,41317,1678805580877 in 213 msec 2023-03-14 14:55:40,969 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=119, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=8816b1e503374db245dbd0800d77f3a4, ASSIGN in 371 msec 2023-03-14 14:55:40,985 INFO [StoreOpener-cfc8b82e17760331b0d59f661140bb28-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region cfc8b82e17760331b0d59f661140bb28 2023-03-14 14:55:40,986 DEBUG [StoreOpener-cfc8b82e17760331b0d59f661140bb28-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/family1 2023-03-14 14:55:40,986 DEBUG [StoreOpener-cfc8b82e17760331b0d59f661140bb28-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/family1 2023-03-14 14:55:40,987 INFO [StoreOpener-cfc8b82e17760331b0d59f661140bb28-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cfc8b82e17760331b0d59f661140bb28 columnFamilyName family1 2023-03-14 14:55:40,987 INFO [StoreOpener-cfc8b82e17760331b0d59f661140bb28-1] regionserver.HStore(310): Store=cfc8b82e17760331b0d59f661140bb28/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 14:55:40,988 INFO [StoreOpener-cfc8b82e17760331b0d59f661140bb28-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region cfc8b82e17760331b0d59f661140bb28 2023-03-14 14:55:40,989 DEBUG [StoreOpener-cfc8b82e17760331b0d59f661140bb28-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/family2 2023-03-14 14:55:40,989 DEBUG [StoreOpener-cfc8b82e17760331b0d59f661140bb28-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/family2 2023-03-14 14:55:40,989 INFO [StoreOpener-cfc8b82e17760331b0d59f661140bb28-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cfc8b82e17760331b0d59f661140bb28 columnFamilyName family2 2023-03-14 14:55:40,989 INFO [StoreOpener-cfc8b82e17760331b0d59f661140bb28-1] regionserver.HStore(310): Store=cfc8b82e17760331b0d59f661140bb28/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-03-14 14:55:40,990 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28 2023-03-14 14:55:40,990 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28 2023-03-14 14:55:40,991 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-03-14 14:55:40,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for cfc8b82e17760331b0d59f661140bb28 2023-03-14 14:55:40,994 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-03-14 14:55:40,994 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened cfc8b82e17760331b0d59f661140bb28; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75202016, jitterRate=0.12059736251831055}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-03-14 14:55:40,994 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for cfc8b82e17760331b0d59f661140bb28: 2023-03-14 14:55:40,995 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,1,1678805739734.cfc8b82e17760331b0d59f661140bb28., pid=122, masterSystemTime=1678805740905 2023-03-14 14:55:40,996 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,1,1678805739734.cfc8b82e17760331b0d59f661140bb28. 2023-03-14 14:55:40,996 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,1,1678805739734.cfc8b82e17760331b0d59f661140bb28. 2023-03-14 14:55:40,996 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=cfc8b82e17760331b0d59f661140bb28, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:40,996 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,1,1678805739734.cfc8b82e17760331b0d59f661140bb28.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1678805740996"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1678805740996"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1678805740996"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1678805740996"}]},"ts":"1678805740996"} 2023-03-14 14:55:40,998 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=122, resume processing ppid=118 2023-03-14 14:55:40,999 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=122, ppid=118, state=SUCCESS; OpenRegionProcedure cfc8b82e17760331b0d59f661140bb28, server=jenkins-hbase20.apache.org,41317,1678805580877 in 243 msec 2023-03-14 14:55:41,000 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=116 2023-03-14 14:55:41,000 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=cfc8b82e17760331b0d59f661140bb28, ASSIGN in 402 msec 2023-03-14 14:55:41,000 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-03-14 14:55:41,000 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1678805741000"}]},"ts":"1678805741000"} 2023-03-14 14:55:41,001 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLED in hbase:meta 2023-03-14 14:55:41,004 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_POST_OPERATION 2023-03-14 14:55:41,005 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=116, state=SUCCESS; CreateTableProcedure table=testMajorCompactionFromAdmin in 1.2400 sec 2023-03-14 14:55:41,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-03-14 14:55:41,873 INFO [Listener at localhost.localdomain/44261] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionFromAdmin, procId: 116 completed 2023-03-14 14:55:41,888 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1678805739734.82c61abd947e5b78a8c268e9c5cab198. with WAL disabled. Data may be lost in the event of a crash. 2023-03-14 14:55:41,888 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1678805739734.cfc8b82e17760331b0d59f661140bb28. with WAL disabled. Data may be lost in the event of a crash. 2023-03-14 14:55:41,889 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1678805739734.8816b1e503374db245dbd0800d77f3a4. with WAL disabled. Data may be lost in the event of a crash. 2023-03-14 14:55:41,891 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:55:41,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-03-14 14:55:41,896 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-03-14 14:55:41,896 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:55:41,896 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-03-14 14:55:41,896 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-03-14 14:55:41,896 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 14:55:41,896 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-14 14:55:41,898 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:41,898 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:55:41,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:55:41,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:55:41,899 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:41,899 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:55:41,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-14 14:55:41,899 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 14:55:41,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:55:41,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-14 14:55:41,899 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-03-14 14:55:41,908 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-03-14 14:55:41,908 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-03-14 14:55:41,908 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:55:41,908 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-03-14 14:55:41,909 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1678805739734.82c61abd947e5b78a8c268e9c5cab198. 2023-03-14 14:55:41,909 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1678805739734.82c61abd947e5b78a8c268e9c5cab198. started... 2023-03-14 14:55:41,910 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-14 14:55:41,912 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 82c61abd947e5b78a8c268e9c5cab198 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-14 14:55:41,912 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:55:41,911 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1678805739734.cfc8b82e17760331b0d59f661140bb28. 2023-03-14 14:55:41,911 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1678805739734.8816b1e503374db245dbd0800d77f3a4. 2023-03-14 14:55:41,912 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1678805739734.cfc8b82e17760331b0d59f661140bb28. started... 2023-03-14 14:55:41,912 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1678805739734.8816b1e503374db245dbd0800d77f3a4. started... 2023-03-14 14:55:41,912 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 8816b1e503374db245dbd0800d77f3a4 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-14 14:55:41,912 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing cfc8b82e17760331b0d59f661140bb28 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-03-14 14:55:41,983 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023031410e4812a0c71456c8600fa31a6148393 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023031410e4812a0c71456c8600fa31a6148393 2023-03-14 14:55:42,369 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303142a77de1dad5a499db61b5b485c86bab1 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202303142a77de1dad5a499db61b5b485c86bab1 2023-03-14 14:55:42,371 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230314877296c125784552a3d1cec4a53d8f0c to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230314877296c125784552a3d1cec4a53d8f0c 2023-03-14 14:55:42,397 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/.tmp/family1/cc7a84b1b9a74ebba0a0ae41641b07a1 2023-03-14 14:55:42,783 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/.tmp/family1/f08b72e8a07943a1881672af3366c62f 2023-03-14 14:55:42,789 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/.tmp/family1/cd44fd3723bd49988b993096fbef546c 2023-03-14 14:55:42,826 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303147cd0dcfdefd043e1b422aecbd2df4ccd to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202303147cd0dcfdefd043e1b422aecbd2df4ccd 2023-03-14 14:55:43,213 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023031424bcf4cc8a084a038e82c39676eadf25 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b2023031424bcf4cc8a084a038e82c39676eadf25 2023-03-14 14:55:43,220 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303145fd6aed3eb9a4855b92f676162ea9e2e to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202303145fd6aed3eb9a4855b92f676162ea9e2e 2023-03-14 14:55:43,230 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/.tmp/family2/319b5aee2a454fcb9bcf0562d3091f65 2023-03-14 14:55:43,233 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/.tmp/family1/cc7a84b1b9a74ebba0a0ae41641b07a1 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/family1/cc7a84b1b9a74ebba0a0ae41641b07a1 2023-03-14 14:55:43,254 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/family1/cc7a84b1b9a74ebba0a0ae41641b07a1, entries=4, sequenceid=5, filesize=5.5 K 2023-03-14 14:55:43,255 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/.tmp/family2/319b5aee2a454fcb9bcf0562d3091f65 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/family2/319b5aee2a454fcb9bcf0562d3091f65 2023-03-14 14:55:43,258 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/family2/319b5aee2a454fcb9bcf0562d3091f65, entries=2, sequenceid=5, filesize=5.1 K 2023-03-14 14:55:43,259 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 8816b1e503374db245dbd0800d77f3a4 in 1347ms, sequenceid=5, compaction requested=false 2023-03-14 14:55:43,259 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionFromAdmin' 2023-03-14 14:55:43,259 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 8816b1e503374db245dbd0800d77f3a4: 2023-03-14 14:55:43,259 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1678805739734.8816b1e503374db245dbd0800d77f3a4. 2023-03-14 14:55:43,259 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-14 14:55:43,618 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/.tmp/family2/c586011dfa0745ecade85cb2474b0b01 2023-03-14 14:55:43,623 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/.tmp/family1/f08b72e8a07943a1881672af3366c62f as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/family1/f08b72e8a07943a1881672af3366c62f 2023-03-14 14:55:43,624 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/.tmp/family2/3d6bcfffaa92469c8f5b897b97446c03 2023-03-14 14:55:43,629 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/.tmp/family1/cd44fd3723bd49988b993096fbef546c as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/family1/cd44fd3723bd49988b993096fbef546c 2023-03-14 14:55:43,648 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/family1/f08b72e8a07943a1881672af3366c62f, entries=4, sequenceid=5, filesize=5.5 K 2023-03-14 14:55:43,649 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/.tmp/family2/c586011dfa0745ecade85cb2474b0b01 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/family2/c586011dfa0745ecade85cb2474b0b01 2023-03-14 14:55:43,652 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/family1/cd44fd3723bd49988b993096fbef546c, entries=4, sequenceid=5, filesize=5.5 K 2023-03-14 14:55:43,652 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/family2/c586011dfa0745ecade85cb2474b0b01, entries=2, sequenceid=5, filesize=5.1 K 2023-03-14 14:55:43,652 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/.tmp/family2/3d6bcfffaa92469c8f5b897b97446c03 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/family2/3d6bcfffaa92469c8f5b897b97446c03 2023-03-14 14:55:43,652 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for cfc8b82e17760331b0d59f661140bb28 in 1740ms, sequenceid=5, compaction requested=false 2023-03-14 14:55:43,653 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for cfc8b82e17760331b0d59f661140bb28: 2023-03-14 14:55:43,653 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1678805739734.cfc8b82e17760331b0d59f661140bb28. 2023-03-14 14:55:43,653 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-14 14:55:43,656 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/family2/3d6bcfffaa92469c8f5b897b97446c03, entries=2, sequenceid=5, filesize=5.1 K 2023-03-14 14:55:43,657 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 82c61abd947e5b78a8c268e9c5cab198 in 1746ms, sequenceid=5, compaction requested=false 2023-03-14 14:55:43,657 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 82c61abd947e5b78a8c268e9c5cab198: 2023-03-14 14:55:43,657 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1678805739734.82c61abd947e5b78a8c268e9c5cab198. 2023-03-14 14:55:43,657 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-14 14:55:43,657 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-14 14:55:43,657 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:43,657 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-03-14 14:55:43,657 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-03-14 14:55:43,658 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-14 14:55:43,658 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:43,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:43,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:55:43,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:55:43,658 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-14 14:55:43,658 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:55:43,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:55:43,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:55:43,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-14 14:55:43,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:43,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:55:43,660 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-03-14 14:55:43,660 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@61425dee[Count = 0] remaining members to acquire global barrier 2023-03-14 14:55:43,660 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-03-14 14:55:43,660 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-14 14:55:43,660 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-14 14:55:43,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-14 14:55:43,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-14 14:55:43,660 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-03-14 14:55:43,660 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-03-14 14:55:43,660 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:55:43,661 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:43,661 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:55:43,661 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-03-14 14:55:43,661 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:43,661 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:55:43,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:43,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:55:43,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:55:43,661 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-03-14 14:55:43,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:55:43,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:55:43,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-14 14:55:43,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:43,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:55:43,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-14 14:55:43,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:43,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:55:43,663 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-03-14 14:55:43,663 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-03-14 14:55:43,663 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:55:43,663 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:55:43,663 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-03-14 14:55:43,663 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:55:43,664 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 14:55:43,664 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 14:55:43,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 14:55:43,664 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 14:55:43,664 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:55:43,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 14:55:43,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:55:43,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:55:43,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:55:43,665 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:43,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:55:43,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:55:43,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 14:55:43,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-14 14:55:43,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:55:43,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-14 14:55:43,666 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:43,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:43,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:55:43,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-14 14:55:43,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:43,667 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:43,667 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-14 14:55:43,667 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-14 14:55:43,667 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:55:43,667 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:43,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:55:43,668 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-03-14 14:55:43,668 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:55:43,667 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:55:43,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:55:43,668 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-03-14 14:55:43,668 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:55:43,668 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-14 14:55:43,668 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-14 14:55:43,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:55:43,668 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-03-14 14:55:43,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:55:43,668 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 14:55:43,668 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:55:43,768 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:55:43,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:55:43,770 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1678805739734.82c61abd947e5b78a8c268e9c5cab198. with WAL disabled. Data may be lost in the event of a crash. 2023-03-14 14:55:43,770 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1678805739734.cfc8b82e17760331b0d59f661140bb28. with WAL disabled. Data may be lost in the event of a crash. 2023-03-14 14:55:43,770 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1678805739734.8816b1e503374db245dbd0800d77f3a4. with WAL disabled. Data may be lost in the event of a crash. 2023-03-14 14:55:43,773 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:55:43,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-03-14 14:55:43,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-03-14 14:55:43,775 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-03-14 14:55:43,775 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:55:43,775 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-03-14 14:55:43,775 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-03-14 14:55:43,776 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 14:55:43,776 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-14 14:55:43,777 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:55:43,777 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:43,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:55:43,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:55:43,777 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:43,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-14 14:55:43,777 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:55:43,778 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 14:55:43,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:55:43,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-14 14:55:43,778 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-03-14 14:55:43,778 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-03-14 14:55:43,778 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-03-14 14:55:43,778 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-03-14 14:55:43,778 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:55:43,778 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-03-14 14:55:43,779 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1678805739734.82c61abd947e5b78a8c268e9c5cab198. 2023-03-14 14:55:43,779 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1678805739734.82c61abd947e5b78a8c268e9c5cab198. started... 2023-03-14 14:55:43,779 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1678805739734.8816b1e503374db245dbd0800d77f3a4. 2023-03-14 14:55:43,779 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-14 14:55:43,779 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:55:43,779 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 82c61abd947e5b78a8c268e9c5cab198 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-14 14:55:43,779 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1678805739734.cfc8b82e17760331b0d59f661140bb28. 2023-03-14 14:55:43,779 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1678805739734.8816b1e503374db245dbd0800d77f3a4. started... 2023-03-14 14:55:43,779 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1678805739734.cfc8b82e17760331b0d59f661140bb28. started... 2023-03-14 14:55:43,779 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 8816b1e503374db245dbd0800d77f3a4 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-14 14:55:43,779 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing cfc8b82e17760331b0d59f661140bb28 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-03-14 14:55:43,822 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023031423c4713ef7064dcbb7f23e6527f3737d to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023031423c4713ef7064dcbb7f23e6527f3737d 2023-03-14 14:55:43,835 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/.tmp/family1/b95505fa46ed4a909b5cc6c5ab3114df 2023-03-14 14:55:43,868 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230314eacf9d02b7954f559d5f55b5c84bd577 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230314eacf9d02b7954f559d5f55b5c84bd577 2023-03-14 14:55:44,223 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023031494c40f16bf31419892e14ad0baab0674 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023031494c40f16bf31419892e14ad0baab0674 2023-03-14 14:55:44,223 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230314311262999fa54ff78a75566744b5eff9 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230314311262999fa54ff78a75566744b5eff9 2023-03-14 14:55:44,248 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/.tmp/family1/8028100671fa4feb9110acdd6262f408 2023-03-14 14:55:44,272 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/.tmp/family2/425a2a56b6e146f8babbd964a1d27def 2023-03-14 14:55:44,275 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/.tmp/family1/b95505fa46ed4a909b5cc6c5ab3114df as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/family1/b95505fa46ed4a909b5cc6c5ab3114df 2023-03-14 14:55:44,298 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/family1/b95505fa46ed4a909b5cc6c5ab3114df, entries=4, sequenceid=9, filesize=5.5 K 2023-03-14 14:55:44,298 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/.tmp/family2/425a2a56b6e146f8babbd964a1d27def as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/family2/425a2a56b6e146f8babbd964a1d27def 2023-03-14 14:55:44,302 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/family2/425a2a56b6e146f8babbd964a1d27def, entries=2, sequenceid=9, filesize=5.1 K 2023-03-14 14:55:44,303 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 82c61abd947e5b78a8c268e9c5cab198 in 524ms, sequenceid=9, compaction requested=false 2023-03-14 14:55:44,303 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 82c61abd947e5b78a8c268e9c5cab198: 2023-03-14 14:55:44,303 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1678805739734.82c61abd947e5b78a8c268e9c5cab198. 2023-03-14 14:55:44,303 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-14 14:55:44,642 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/.tmp/family1/6cb3cd51ea5848c38e748455bc078fc3 2023-03-14 14:55:44,692 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023031479d883bd4c574914903520b863f9b936 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c2023031479d883bd4c574914903520b863f9b936 2023-03-14 14:55:45,079 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303144a09ba1f638c4152a47e0c32ed923ff4 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202303144a09ba1f638c4152a47e0c32ed923ff4 2023-03-14 14:55:45,085 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/.tmp/family2/9cbeb089a23a4f84bfcf883ed185024a 2023-03-14 14:55:45,087 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/.tmp/family1/6cb3cd51ea5848c38e748455bc078fc3 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/family1/6cb3cd51ea5848c38e748455bc078fc3 2023-03-14 14:55:45,095 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/.tmp/family2/f5782a179bac48cf853cbf2e73d6ae01 2023-03-14 14:55:45,099 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/.tmp/family1/8028100671fa4feb9110acdd6262f408 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/family1/8028100671fa4feb9110acdd6262f408 2023-03-14 14:55:45,108 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/family1/6cb3cd51ea5848c38e748455bc078fc3, entries=4, sequenceid=9, filesize=5.5 K 2023-03-14 14:55:45,109 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/.tmp/family2/9cbeb089a23a4f84bfcf883ed185024a as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/family2/9cbeb089a23a4f84bfcf883ed185024a 2023-03-14 14:55:45,113 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/family2/9cbeb089a23a4f84bfcf883ed185024a, entries=2, sequenceid=9, filesize=5.1 K 2023-03-14 14:55:45,114 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for cfc8b82e17760331b0d59f661140bb28 in 1335ms, sequenceid=9, compaction requested=false 2023-03-14 14:55:45,114 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for cfc8b82e17760331b0d59f661140bb28: 2023-03-14 14:55:45,114 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1678805739734.cfc8b82e17760331b0d59f661140bb28. 2023-03-14 14:55:45,114 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-14 14:55:45,123 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/family1/8028100671fa4feb9110acdd6262f408, entries=4, sequenceid=9, filesize=5.5 K 2023-03-14 14:55:45,124 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/.tmp/family2/f5782a179bac48cf853cbf2e73d6ae01 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/family2/f5782a179bac48cf853cbf2e73d6ae01 2023-03-14 14:55:45,128 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/family2/f5782a179bac48cf853cbf2e73d6ae01, entries=2, sequenceid=9, filesize=5.1 K 2023-03-14 14:55:45,128 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 8816b1e503374db245dbd0800d77f3a4 in 1349ms, sequenceid=9, compaction requested=false 2023-03-14 14:55:45,128 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 8816b1e503374db245dbd0800d77f3a4: 2023-03-14 14:55:45,128 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1678805739734.8816b1e503374db245dbd0800d77f3a4. 2023-03-14 14:55:45,128 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-14 14:55:45,128 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-14 14:55:45,128 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:45,129 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-03-14 14:55:45,129 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-03-14 14:55:45,129 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:45,129 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-14 14:55:45,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:45,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:55:45,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:55:45,130 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-14 14:55:45,130 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:55:45,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:55:45,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:55:45,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-14 14:55:45,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:45,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:55:45,131 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-03-14 14:55:45,131 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@705e7055[Count = 0] remaining members to acquire global barrier 2023-03-14 14:55:45,131 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-03-14 14:55:45,131 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-14 14:55:45,131 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-14 14:55:45,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-14 14:55:45,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-14 14:55:45,132 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-03-14 14:55:45,132 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-03-14 14:55:45,132 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:45,132 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:55:45,132 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:55:45,132 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-03-14 14:55:45,132 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:45,132 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:55:45,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:45,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:55:45,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:55:45,132 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-03-14 14:55:45,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:55:45,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:55:45,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-14 14:55:45,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:45,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:55:45,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-14 14:55:45,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:45,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:55:45,134 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-03-14 14:55:45,134 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-03-14 14:55:45,134 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:55:45,134 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:55:45,134 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-03-14 14:55:45,134 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:55:45,135 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 14:55:45,135 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 14:55:45,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 14:55:45,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:55:45,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:55:45,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 14:55:45,135 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:55:45,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 14:55:45,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:55:45,136 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:45,136 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:55:45,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:55:45,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-14 14:55:45,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 14:55:45,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:55:45,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-14 14:55:45,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:45,136 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:45,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:55:45,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-14 14:55:45,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:45,138 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:45,138 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:55:45,138 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-14 14:55:45,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:55:45,138 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:55:45,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:55:45,138 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:55:45,138 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-03-14 14:55:45,138 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:55:45,138 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-14 14:55:45,138 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-03-14 14:55:45,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:55:45,138 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-03-14 14:55:45,138 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:45,138 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:55:45,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:55:45,138 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-14 14:55:45,138 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-14 14:55:45,138 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 14:55:45,238 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:55:45,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:55:45,240 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1678805739734.82c61abd947e5b78a8c268e9c5cab198. with WAL disabled. Data may be lost in the event of a crash. 2023-03-14 14:55:45,240 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1678805739734.cfc8b82e17760331b0d59f661140bb28. with WAL disabled. Data may be lost in the event of a crash. 2023-03-14 14:55:45,240 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1678805739734.8816b1e503374db245dbd0800d77f3a4. with WAL disabled. Data may be lost in the event of a crash. 2023-03-14 14:55:45,242 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:55:45,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-03-14 14:55:45,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-03-14 14:55:45,250 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-03-14 14:55:45,250 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:55:45,250 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-03-14 14:55:45,250 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-03-14 14:55:45,251 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 14:55:45,251 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-14 14:55:45,252 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:55:45,252 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:45,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:55:45,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:55:45,252 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:45,252 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:55:45,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-14 14:55:45,252 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 14:55:45,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:55:45,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-14 14:55:45,253 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-03-14 14:55:45,253 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-03-14 14:55:45,253 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-03-14 14:55:45,253 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-03-14 14:55:45,253 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:55:45,253 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-03-14 14:55:45,253 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1678805739734.82c61abd947e5b78a8c268e9c5cab198. 2023-03-14 14:55:45,253 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1678805739734.8816b1e503374db245dbd0800d77f3a4. 2023-03-14 14:55:45,253 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1678805739734.82c61abd947e5b78a8c268e9c5cab198. started... 2023-03-14 14:55:45,253 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-14 14:55:45,253 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:55:45,253 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1678805739734.cfc8b82e17760331b0d59f661140bb28. 2023-03-14 14:55:45,253 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 82c61abd947e5b78a8c268e9c5cab198 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-14 14:55:45,253 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1678805739734.8816b1e503374db245dbd0800d77f3a4. started... 2023-03-14 14:55:45,253 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1678805739734.cfc8b82e17760331b0d59f661140bb28. started... 2023-03-14 14:55:45,253 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 8816b1e503374db245dbd0800d77f3a4 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-14 14:55:45,254 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing cfc8b82e17760331b0d59f661140bb28 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-03-14 14:55:45,304 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230314966ff63ef6fe4f35a3e52db61d251038 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230314966ff63ef6fe4f35a3e52db61d251038 2023-03-14 14:55:45,713 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230314375d864a54e2443d8417037f22244eb4 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230314375d864a54e2443d8417037f22244eb4 2023-03-14 14:55:45,713 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230314bd97bf0cc0bf42fda7c3a0ce6162d790 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230314bd97bf0cc0bf42fda7c3a0ce6162d790 2023-03-14 14:55:45,724 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/.tmp/family1/9104f8775604482baed37291c17754ba 2023-03-14 14:55:45,759 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023031453ce0210cb734f928420355e9cd1b4af to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e2023031453ce0210cb734f928420355e9cd1b4af 2023-03-14 14:55:46,126 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/.tmp/family1/bd2b17c1a5a34843b67a98a90395a7a9 2023-03-14 14:55:46,134 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/.tmp/family1/bddb243d613b4cceb7a55d1cc69a2931 2023-03-14 14:55:46,164 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/.tmp/family2/8a75ea00c9514899a3df56f48e53b3a8 2023-03-14 14:55:46,167 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/.tmp/family1/9104f8775604482baed37291c17754ba as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/family1/9104f8775604482baed37291c17754ba 2023-03-14 14:55:46,168 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202303142d484289cbd843069e0838388d7a14e1 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202303142d484289cbd843069e0838388d7a14e1 2023-03-14 14:55:46,186 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/family1/9104f8775604482baed37291c17754ba, entries=4, sequenceid=13, filesize=5.5 K 2023-03-14 14:55:46,187 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/.tmp/family2/8a75ea00c9514899a3df56f48e53b3a8 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/family2/8a75ea00c9514899a3df56f48e53b3a8 2023-03-14 14:55:46,190 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/family2/8a75ea00c9514899a3df56f48e53b3a8, entries=2, sequenceid=13, filesize=5.1 K 2023-03-14 14:55:46,190 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 82c61abd947e5b78a8c268e9c5cab198 in 937ms, sequenceid=13, compaction requested=true 2023-03-14 14:55:46,190 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 82c61abd947e5b78a8c268e9c5cab198: 2023-03-14 14:55:46,191 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1678805739734.82c61abd947e5b78a8c268e9c5cab198. 2023-03-14 14:55:46,191 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-14 14:55:46,446 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-03-14 14:55:46,497 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-14 14:55:46,497 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x273fd13e to 127.0.0.1:50211 2023-03-14 14:55:46,497 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-14 14:55:46,497 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-14 14:55:46,497 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6c1ad31e to 127.0.0.1:50211 2023-03-14 14:55:46,497 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-14 14:55:46,570 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230314353bb6223d0f4f2fad5fef7c26313754 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20230314353bb6223d0f4f2fad5fef7c26313754 2023-03-14 14:55:46,576 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/.tmp/family2/3c98260b48a444f484a5f4ae2050602d 2023-03-14 14:55:46,580 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/.tmp/family1/bddb243d613b4cceb7a55d1cc69a2931 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/family1/bddb243d613b4cceb7a55d1cc69a2931 2023-03-14 14:55:46,600 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/family1/bddb243d613b4cceb7a55d1cc69a2931, entries=4, sequenceid=13, filesize=5.5 K 2023-03-14 14:55:46,601 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/.tmp/family2/3c98260b48a444f484a5f4ae2050602d as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/family2/3c98260b48a444f484a5f4ae2050602d 2023-03-14 14:55:46,604 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/family2/3c98260b48a444f484a5f4ae2050602d, entries=2, sequenceid=13, filesize=5.1 K 2023-03-14 14:55:46,605 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for cfc8b82e17760331b0d59f661140bb28 in 1352ms, sequenceid=13, compaction requested=true 2023-03-14 14:55:46,605 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for cfc8b82e17760331b0d59f661140bb28: 2023-03-14 14:55:46,605 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1678805739734.cfc8b82e17760331b0d59f661140bb28. 2023-03-14 14:55:46,605 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-14 14:55:46,977 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/.tmp/family2/00d363fc1a174bd68a6589893c6892fd 2023-03-14 14:55:46,981 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/.tmp/family1/bd2b17c1a5a34843b67a98a90395a7a9 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/family1/bd2b17c1a5a34843b67a98a90395a7a9 2023-03-14 14:55:47,005 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/family1/bd2b17c1a5a34843b67a98a90395a7a9, entries=4, sequenceid=13, filesize=5.5 K 2023-03-14 14:55:47,006 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/.tmp/family2/00d363fc1a174bd68a6589893c6892fd as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/family2/00d363fc1a174bd68a6589893c6892fd 2023-03-14 14:55:47,010 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/family2/00d363fc1a174bd68a6589893c6892fd, entries=2, sequenceid=13, filesize=5.1 K 2023-03-14 14:55:47,010 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 8816b1e503374db245dbd0800d77f3a4 in 1757ms, sequenceid=13, compaction requested=true 2023-03-14 14:55:47,011 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 8816b1e503374db245dbd0800d77f3a4: 2023-03-14 14:55:47,011 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1678805739734.8816b1e503374db245dbd0800d77f3a4. 2023-03-14 14:55:47,011 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-14 14:55:47,011 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-14 14:55:47,011 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:47,011 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-03-14 14:55:47,011 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-03-14 14:55:47,012 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-14 14:55:47,012 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:47,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:47,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:55:47,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:55:47,012 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-14 14:55:47,012 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:55:47,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:55:47,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:55:47,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-14 14:55:47,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:47,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:55:47,014 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-03-14 14:55:47,014 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@29070983[Count = 0] remaining members to acquire global barrier 2023-03-14 14:55:47,014 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-03-14 14:55:47,014 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-14 14:55:47,014 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-14 14:55:47,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-14 14:55:47,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-14 14:55:47,015 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-03-14 14:55:47,015 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-03-14 14:55:47,015 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:47,015 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:55:47,015 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:55:47,015 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-03-14 14:55:47,015 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:47,015 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:55:47,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:47,016 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-03-14 14:55:47,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:55:47,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:55:47,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:55:47,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:55:47,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-14 14:55:47,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:47,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:55:47,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-14 14:55:47,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:47,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:55:47,018 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-03-14 14:55:47,018 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-03-14 14:55:47,018 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:55:47,018 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:55:47,018 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-03-14 14:55:47,018 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:55:47,019 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 14:55:47,019 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 14:55:47,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 14:55:47,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 14:55:47,019 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:55:47,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 14:55:47,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:55:47,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:55:47,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:55:47,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:55:47,019 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:47,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:55:47,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 14:55:47,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-14 14:55:47,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:55:47,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-14 14:55:47,020 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:47,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:47,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:55:47,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-14 14:55:47,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:47,023 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:47,023 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:55:47,023 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-14 14:55:47,023 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:55:47,023 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-03-14 14:55:47,023 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-14 14:55:47,023 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-03-14 14:55:47,023 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:55:47,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:55:47,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:55:47,023 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:55:47,023 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:47,023 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-14 14:55:47,023 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-14 14:55:47,023 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-03-14 14:55:47,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:55:47,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:55:47,023 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 14:55:47,023 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:55:47,123 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:55:47,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:55:47,125 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1678805739734.82c61abd947e5b78a8c268e9c5cab198. with WAL disabled. Data may be lost in the event of a crash. 2023-03-14 14:55:47,125 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1678805739734.cfc8b82e17760331b0d59f661140bb28. with WAL disabled. Data may be lost in the event of a crash. 2023-03-14 14:55:47,125 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1678805739734.8816b1e503374db245dbd0800d77f3a4. with WAL disabled. Data may be lost in the event of a crash. 2023-03-14 14:55:47,128 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:55:47,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-03-14 14:55:47,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-03-14 14:55:47,131 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-03-14 14:55:47,131 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:55:47,131 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-03-14 14:55:47,131 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-03-14 14:55:47,131 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 14:55:47,131 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-14 14:55:47,132 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:55:47,132 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:47,132 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:55:47,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:55:47,132 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:47,132 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:55:47,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-14 14:55:47,133 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 14:55:47,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:55:47,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-14 14:55:47,133 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-03-14 14:55:47,137 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-03-14 14:55:47,138 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-03-14 14:55:47,138 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-03-14 14:55:47,138 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:55:47,138 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-03-14 14:55:47,138 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1678805739734.82c61abd947e5b78a8c268e9c5cab198. 2023-03-14 14:55:47,138 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1678805739734.8816b1e503374db245dbd0800d77f3a4. 2023-03-14 14:55:47,139 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-14 14:55:47,139 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:55:47,139 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1678805739734.8816b1e503374db245dbd0800d77f3a4. started... 2023-03-14 14:55:47,139 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1678805739734.82c61abd947e5b78a8c268e9c5cab198. started... 2023-03-14 14:55:47,139 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1678805739734.cfc8b82e17760331b0d59f661140bb28. 2023-03-14 14:55:47,139 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 82c61abd947e5b78a8c268e9c5cab198 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-14 14:55:47,139 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1678805739734.cfc8b82e17760331b0d59f661140bb28. started... 2023-03-14 14:55:47,139 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 8816b1e503374db245dbd0800d77f3a4 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-14 14:55:47,139 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing cfc8b82e17760331b0d59f661140bb28 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-03-14 14:55:47,194 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303144afa05986f5c409eb60b961cbe80da1f to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202303144afa05986f5c409eb60b961cbe80da1f 2023-03-14 14:55:47,595 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230314f2696bbbe76d42a997854dc55646fc96 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230314f2696bbbe76d42a997854dc55646fc96 2023-03-14 14:55:47,596 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230314b1f9190c85784ca6962d0ad00ba998f9 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230314b1f9190c85784ca6962d0ad00ba998f9 2023-03-14 14:55:47,607 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/.tmp/family1/91e7cc21a6c5402cbf2a9e768eb1da75 2023-03-14 14:55:47,608 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/.tmp/family1/8082e757b7a9438d99eadbcdcc4c3f51 2023-03-14 14:55:48,020 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/.tmp/family1/d4987168aa3b43fe9c6fdbad0d2a0658 2023-03-14 14:55:48,038 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230314b3067fd030fe489c88b25cd162efe478 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20230314b3067fd030fe489c88b25cd162efe478 2023-03-14 14:55:48,038 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230314923ff8c44e804568b758fe9f47c458a9 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20230314923ff8c44e804568b758fe9f47c458a9 2023-03-14 14:55:48,047 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/.tmp/family2/9a2bb8e6f9024616b55b8e1e59f9b1de 2023-03-14 14:55:48,051 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/.tmp/family1/91e7cc21a6c5402cbf2a9e768eb1da75 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/family1/91e7cc21a6c5402cbf2a9e768eb1da75 2023-03-14 14:55:48,071 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/family1/91e7cc21a6c5402cbf2a9e768eb1da75, entries=4, sequenceid=17, filesize=5.5 K 2023-03-14 14:55:48,072 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/.tmp/family2/9a2bb8e6f9024616b55b8e1e59f9b1de as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/family2/9a2bb8e6f9024616b55b8e1e59f9b1de 2023-03-14 14:55:48,076 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/family2/9a2bb8e6f9024616b55b8e1e59f9b1de, entries=2, sequenceid=17, filesize=5.1 K 2023-03-14 14:55:48,076 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 8816b1e503374db245dbd0800d77f3a4 in 937ms, sequenceid=17, compaction requested=true 2023-03-14 14:55:48,076 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 8816b1e503374db245dbd0800d77f3a4: 2023-03-14 14:55:48,077 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1678805739734.8816b1e503374db245dbd0800d77f3a4. 2023-03-14 14:55:48,077 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-14 14:55:48,448 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/.tmp/family2/e320b9760a2b44e39ae52818a8d8b96e 2023-03-14 14:55:48,452 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/.tmp/family1/8082e757b7a9438d99eadbcdcc4c3f51 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/family1/8082e757b7a9438d99eadbcdcc4c3f51 2023-03-14 14:55:48,463 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230314dfdca1985f354889b8864963991f73e1 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230314dfdca1985f354889b8864963991f73e1 2023-03-14 14:55:48,471 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/.tmp/family2/d7d6a5e416b1445b8cb0374d54319cde 2023-03-14 14:55:48,474 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/family1/8082e757b7a9438d99eadbcdcc4c3f51, entries=4, sequenceid=17, filesize=5.5 K 2023-03-14 14:55:48,475 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/.tmp/family1/d4987168aa3b43fe9c6fdbad0d2a0658 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/family1/d4987168aa3b43fe9c6fdbad0d2a0658 2023-03-14 14:55:48,475 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/.tmp/family2/e320b9760a2b44e39ae52818a8d8b96e as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/family2/e320b9760a2b44e39ae52818a8d8b96e 2023-03-14 14:55:48,479 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/family2/e320b9760a2b44e39ae52818a8d8b96e, entries=2, sequenceid=17, filesize=5.1 K 2023-03-14 14:55:48,479 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for cfc8b82e17760331b0d59f661140bb28 in 1340ms, sequenceid=17, compaction requested=true 2023-03-14 14:55:48,479 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for cfc8b82e17760331b0d59f661140bb28: 2023-03-14 14:55:48,479 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1678805739734.cfc8b82e17760331b0d59f661140bb28. 2023-03-14 14:55:48,479 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-14 14:55:48,502 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/family1/d4987168aa3b43fe9c6fdbad0d2a0658, entries=4, sequenceid=17, filesize=5.5 K 2023-03-14 14:55:48,503 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/.tmp/family2/d7d6a5e416b1445b8cb0374d54319cde as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/family2/d7d6a5e416b1445b8cb0374d54319cde 2023-03-14 14:55:48,506 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/family2/d7d6a5e416b1445b8cb0374d54319cde, entries=2, sequenceid=17, filesize=5.1 K 2023-03-14 14:55:48,506 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 82c61abd947e5b78a8c268e9c5cab198 in 1367ms, sequenceid=17, compaction requested=true 2023-03-14 14:55:48,507 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 82c61abd947e5b78a8c268e9c5cab198: 2023-03-14 14:55:48,507 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1678805739734.82c61abd947e5b78a8c268e9c5cab198. 2023-03-14 14:55:48,507 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-14 14:55:48,507 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-14 14:55:48,507 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:48,507 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-03-14 14:55:48,507 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-03-14 14:55:48,508 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-14 14:55:48,508 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:48,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:48,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:55:48,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:55:48,508 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-14 14:55:48,508 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:55:48,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:55:48,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:55:48,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-14 14:55:48,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:48,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:55:48,509 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-03-14 14:55:48,510 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@36a2946d[Count = 0] remaining members to acquire global barrier 2023-03-14 14:55:48,510 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-03-14 14:55:48,510 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-14 14:55:48,510 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-14 14:55:48,510 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-14 14:55:48,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-14 14:55:48,510 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-03-14 14:55:48,510 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-03-14 14:55:48,510 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:48,510 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:55:48,510 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:55:48,511 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-03-14 14:55:48,511 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:48,511 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:55:48,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:48,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:55:48,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:55:48,511 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-03-14 14:55:48,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:55:48,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:55:48,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-14 14:55:48,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:48,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:55:48,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-14 14:55:48,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:48,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:55:48,513 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-03-14 14:55:48,513 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-03-14 14:55:48,513 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:55:48,513 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:55:48,513 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-03-14 14:55:48,513 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:55:48,514 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 14:55:48,514 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 14:55:48,514 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:55:48,514 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 14:55:48,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 14:55:48,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 14:55:48,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:55:48,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:55:48,514 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:55:48,514 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:48,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:55:48,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:55:48,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 14:55:48,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-14 14:55:48,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:55:48,515 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:48,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-14 14:55:48,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:48,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:55:48,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-14 14:55:48,516 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:48,516 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:55:48,516 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-14 14:55:48,516 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:55:48,516 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-03-14 14:55:48,516 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:55:48,516 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-14 14:55:48,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:55:48,516 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:55:48,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:55:48,516 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:48,516 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-03-14 14:55:48,516 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-03-14 14:55:48,516 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-14 14:55:48,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:55:48,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:55:48,516 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:55:48,516 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-14 14:55:48,517 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 14:55:48,617 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:55:48,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:55:48,625 DEBUG [Listener at localhost.localdomain/44261] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-14 14:55:48,631 DEBUG [Listener at localhost.localdomain/44261] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-14 14:55:48,638 DEBUG [Listener at localhost.localdomain/44261] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-14 14:55:48,638 DEBUG [Listener at localhost.localdomain/44261] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-14 14:55:48,725 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-03-14 14:55:48,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-03-14 14:55:48,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-03-14 14:55:48,727 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-03-14 14:55:48,727 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:55:48,727 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-03-14 14:55:48,727 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-03-14 14:55:48,727 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 14:55:48,727 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-14 14:55:48,728 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:55:48,728 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:48,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:55:48,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:55:48,728 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:48,728 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-03-14 14:55:48,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-14 14:55:48,728 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 14:55:48,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-03-14 14:55:48,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-14 14:55:48,729 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-03-14 14:55:48,729 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-03-14 14:55:48,729 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-03-14 14:55:48,729 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-03-14 14:55:48,729 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-03-14 14:55:48,729 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-03-14 14:55:48,730 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1678805739734.82c61abd947e5b78a8c268e9c5cab198. 2023-03-14 14:55:48,730 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1678805739734.82c61abd947e5b78a8c268e9c5cab198. started... 2023-03-14 14:55:48,730 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1678805739734.8816b1e503374db245dbd0800d77f3a4. 2023-03-14 14:55:48,730 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 82c61abd947e5b78a8c268e9c5cab198 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-14 14:55:48,730 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-03-14 14:55:48,730 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-03-14 14:55:48,730 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1678805739734.8816b1e503374db245dbd0800d77f3a4. started... 2023-03-14 14:55:48,730 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1678805739734.cfc8b82e17760331b0d59f661140bb28. 2023-03-14 14:55:48,730 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 8816b1e503374db245dbd0800d77f3a4 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-14 14:55:48,730 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1678805739734.cfc8b82e17760331b0d59f661140bb28. started... 2023-03-14 14:55:48,730 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing cfc8b82e17760331b0d59f661140bb28 2/2 column families, dataSize=138 B heapSize=944 B 2023-03-14 14:55:49,224 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/.tmp/family1/1677b7e83c134c4b8a3b1f415d66321a 2023-03-14 14:55:49,253 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1677b7e83c134c4b8a3b1f415d66321a 2023-03-14 14:55:49,622 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/.tmp/family1/aaeb1b470b2240e7871c58afb133cc48 2023-03-14 14:55:49,630 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/.tmp/family1/ec523000919640899905d0aef9c52a06 2023-03-14 14:55:49,649 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ec523000919640899905d0aef9c52a06 2023-03-14 14:55:49,651 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for aaeb1b470b2240e7871c58afb133cc48 2023-03-14 14:55:50,060 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/.tmp/family2/38cb4f93b424429f9809757cf48761d6 2023-03-14 14:55:50,061 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/.tmp/family2/ac9eb9a12f084672ba2db678edfd2d90 2023-03-14 14:55:50,063 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 38cb4f93b424429f9809757cf48761d6 2023-03-14 14:55:50,063 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/.tmp/family1/ec523000919640899905d0aef9c52a06 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/family1/ec523000919640899905d0aef9c52a06 2023-03-14 14:55:50,063 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ac9eb9a12f084672ba2db678edfd2d90 2023-03-14 14:55:50,064 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/.tmp/family2/f1c0d036f63248b1af0b08ba35c22fea 2023-03-14 14:55:50,064 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/.tmp/family1/aaeb1b470b2240e7871c58afb133cc48 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/family1/aaeb1b470b2240e7871c58afb133cc48 2023-03-14 14:55:50,067 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f1c0d036f63248b1af0b08ba35c22fea 2023-03-14 14:55:50,067 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/.tmp/family1/1677b7e83c134c4b8a3b1f415d66321a as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/family1/1677b7e83c134c4b8a3b1f415d66321a 2023-03-14 14:55:50,086 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ec523000919640899905d0aef9c52a06 2023-03-14 14:55:50,086 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/family1/ec523000919640899905d0aef9c52a06, entries=3, sequenceid=23, filesize=5.2 K 2023-03-14 14:55:50,087 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1677b7e83c134c4b8a3b1f415d66321a 2023-03-14 14:55:50,087 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/family1/1677b7e83c134c4b8a3b1f415d66321a, entries=3, sequenceid=23, filesize=5.2 K 2023-03-14 14:55:50,087 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/.tmp/family2/38cb4f93b424429f9809757cf48761d6 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/family2/38cb4f93b424429f9809757cf48761d6 2023-03-14 14:55:50,087 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/.tmp/family2/f1c0d036f63248b1af0b08ba35c22fea as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/family2/f1c0d036f63248b1af0b08ba35c22fea 2023-03-14 14:55:50,090 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 38cb4f93b424429f9809757cf48761d6 2023-03-14 14:55:50,090 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f1c0d036f63248b1af0b08ba35c22fea 2023-03-14 14:55:50,090 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/family2/38cb4f93b424429f9809757cf48761d6, entries=1, sequenceid=23, filesize=5.0 K 2023-03-14 14:55:50,090 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/family2/f1c0d036f63248b1af0b08ba35c22fea, entries=1, sequenceid=23, filesize=5.0 K 2023-03-14 14:55:50,090 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for aaeb1b470b2240e7871c58afb133cc48 2023-03-14 14:55:50,090 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/family1/aaeb1b470b2240e7871c58afb133cc48, entries=3, sequenceid=23, filesize=5.2 K 2023-03-14 14:55:50,091 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 8816b1e503374db245dbd0800d77f3a4 in 1361ms, sequenceid=23, compaction requested=true 2023-03-14 14:55:50,091 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 82c61abd947e5b78a8c268e9c5cab198 in 1361ms, sequenceid=23, compaction requested=true 2023-03-14 14:55:50,091 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/.tmp/family2/ac9eb9a12f084672ba2db678edfd2d90 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/family2/ac9eb9a12f084672ba2db678edfd2d90 2023-03-14 14:55:50,091 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 82c61abd947e5b78a8c268e9c5cab198: 2023-03-14 14:55:50,091 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 8816b1e503374db245dbd0800d77f3a4: 2023-03-14 14:55:50,091 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1678805739734.82c61abd947e5b78a8c268e9c5cab198. 2023-03-14 14:55:50,091 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1678805739734.8816b1e503374db245dbd0800d77f3a4. 2023-03-14 14:55:50,091 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-03-14 14:55:50,091 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-03-14 14:55:50,094 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ac9eb9a12f084672ba2db678edfd2d90 2023-03-14 14:55:50,094 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/family2/ac9eb9a12f084672ba2db678edfd2d90, entries=1, sequenceid=23, filesize=5.0 K 2023-03-14 14:55:50,094 INFO [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for cfc8b82e17760331b0d59f661140bb28 in 1364ms, sequenceid=23, compaction requested=true 2023-03-14 14:55:50,095 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for cfc8b82e17760331b0d59f661140bb28: 2023-03-14 14:55:50,095 DEBUG [rs(jenkins-hbase20.apache.org,41317,1678805580877)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1678805739734.cfc8b82e17760331b0d59f661140bb28. 2023-03-14 14:55:50,095 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-03-14 14:55:50,095 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-03-14 14:55:50,095 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:50,095 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-03-14 14:55:50,095 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-03-14 14:55:50,096 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:50,096 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-14 14:55:50,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:50,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:55:50,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:55:50,096 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-14 14:55:50,096 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-03-14 14:55:50,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:55:50,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:55:50,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-14 14:55:50,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:50,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:55:50,097 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,41317,1678805580877' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-03-14 14:55:50,097 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@45fc027a[Count = 0] remaining members to acquire global barrier 2023-03-14 14:55:50,097 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-03-14 14:55:50,097 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-14 14:55:50,098 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-14 14:55:50,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-14 14:55:50,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-14 14:55:50,098 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-03-14 14:55:50,098 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-03-14 14:55:50,098 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:50,098 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-03-14 14:55:50,098 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase20.apache.org,41317,1678805580877' in zk 2023-03-14 14:55:50,099 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-03-14 14:55:50,099 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:50,099 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:55:50,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:50,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:55:50,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:55:50,099 DEBUG [member: 'jenkins-hbase20.apache.org,41317,1678805580877' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-03-14 14:55:50,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:55:50,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:55:50,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-14 14:55:50,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:50,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:55:50,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-14 14:55:50,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:50,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase20.apache.org,41317,1678805580877': 2023-03-14 14:55:50,101 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,41317,1678805580877' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-03-14 14:55:50,101 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-03-14 14:55:50,101 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-03-14 14:55:50,101 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-03-14 14:55:50,101 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-03-14 14:55:50,101 INFO [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-03-14 14:55:50,102 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 14:55:50,102 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 14:55:50,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 14:55:50,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-03-14 14:55:50,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-03-14 14:55:50,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 14:55:50,102 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:55:50,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 14:55:50,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-03-14 14:55:50,102 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:50,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:55:50,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:55:50,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-14 14:55:50,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 14:55:50,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-03-14 14:55:50,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-14 14:55:50,103 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:50,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:50,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-03-14 14:55:50,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-03-14 14:55:50,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:50,105 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:50,105 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-14 14:55:50,105 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-03-14 14:55:50,105 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:50,105 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-14 14:55:50,105 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-03-14 14:55:50,105 DEBUG [(jenkins-hbase20.apache.org,38031,1678805579674)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-03-14 14:55:50,105 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-03-14 14:55:50,105 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-03-14 14:55:50,105 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-03-14 14:55:50,105 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-03-14 14:55:50,105 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-03-14 14:55:50,105 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-03-14 14:55:50,105 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-03-14 14:55:50,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-03-14 14:55:50,106 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-03-14 14:55:50,106 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-03-14 14:55:50,106 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-03-14 14:55:50,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-03-14 14:55:50,206 DEBUG [Listener at localhost.localdomain/44261] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-03-14 14:55:50,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38031] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-03-14 14:55:50,207 DEBUG [Listener at localhost.localdomain/44261] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-14 14:55:50,207 DEBUG [Listener at localhost.localdomain/44261] regionserver.HStore(1912): 82c61abd947e5b78a8c268e9c5cab198/family1 is initiating major compaction (all files) 2023-03-14 14:55:50,207 INFO [Listener at localhost.localdomain/44261] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-14 14:55:50,207 INFO [Listener at localhost.localdomain/44261] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-14 14:55:50,207 INFO [Listener at localhost.localdomain/44261] regionserver.HRegion(2259): Starting compaction of 82c61abd947e5b78a8c268e9c5cab198/family1 in testMajorCompactionFromAdmin,,1678805739734.82c61abd947e5b78a8c268e9c5cab198. 2023-03-14 14:55:50,207 INFO [Listener at localhost.localdomain/44261] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/family1/cd44fd3723bd49988b993096fbef546c, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/family1/b95505fa46ed4a909b5cc6c5ab3114df, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/family1/9104f8775604482baed37291c17754ba, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/family1/d4987168aa3b43fe9c6fdbad0d2a0658, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/family1/1677b7e83c134c4b8a3b1f415d66321a] into tmpdir=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/.tmp, totalSize=27.1 K 2023-03-14 14:55:50,208 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting cd44fd3723bd49988b993096fbef546c, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678805741888 2023-03-14 14:55:50,208 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting b95505fa46ed4a909b5cc6c5ab3114df, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678805743770 2023-03-14 14:55:50,209 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting 9104f8775604482baed37291c17754ba, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678805745240 2023-03-14 14:55:50,209 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting d4987168aa3b43fe9c6fdbad0d2a0658, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678805747125 2023-03-14 14:55:50,209 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting 1677b7e83c134c4b8a3b1f415d66321a, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-14 14:55:50,218 INFO [Listener at localhost.localdomain/44261] throttle.PressureAwareThroughputController(145): 82c61abd947e5b78a8c268e9c5cab198#family1#compaction#198 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-14 14:55:50,267 INFO [Listener at localhost.localdomain/44261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202303148f388b01f0ed41bb94b033d5d81d9345_del 2023-03-14 14:55:50,268 INFO [Listener at localhost.localdomain/44261] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303148f388b01f0ed41bb94b033d5d81d9345_del to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202303148f388b01f0ed41bb94b033d5d81d9345_del 2023-03-14 14:55:51,120 INFO [Listener at localhost.localdomain/44261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for adc8db03a4d8465c90b12dc090d9e1d2 2023-03-14 14:55:51,121 DEBUG [Listener at localhost.localdomain/44261] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/.tmp/family1/adc8db03a4d8465c90b12dc090d9e1d2 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/family1/adc8db03a4d8465c90b12dc090d9e1d2 2023-03-14 14:55:51,141 INFO [Listener at localhost.localdomain/44261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for adc8db03a4d8465c90b12dc090d9e1d2 2023-03-14 14:55:51,142 INFO [Listener at localhost.localdomain/44261] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 82c61abd947e5b78a8c268e9c5cab198/family1 of 82c61abd947e5b78a8c268e9c5cab198 into adc8db03a4d8465c90b12dc090d9e1d2(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-14 14:55:51,142 DEBUG [Listener at localhost.localdomain/44261] regionserver.HRegion(2289): Compaction status journal for 82c61abd947e5b78a8c268e9c5cab198: 2023-03-14 14:55:51,142 DEBUG [Listener at localhost.localdomain/44261] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-14 14:55:51,142 DEBUG [Listener at localhost.localdomain/44261] regionserver.HStore(1912): 82c61abd947e5b78a8c268e9c5cab198/family2 is initiating major compaction (all files) 2023-03-14 14:55:51,142 INFO [Listener at localhost.localdomain/44261] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-14 14:55:51,142 INFO [Listener at localhost.localdomain/44261] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-14 14:55:51,144 INFO [Listener at localhost.localdomain/44261] regionserver.HRegion(2259): Starting compaction of 82c61abd947e5b78a8c268e9c5cab198/family2 in testMajorCompactionFromAdmin,,1678805739734.82c61abd947e5b78a8c268e9c5cab198. 2023-03-14 14:55:51,144 INFO [Listener at localhost.localdomain/44261] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/family2/3d6bcfffaa92469c8f5b897b97446c03, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/family2/425a2a56b6e146f8babbd964a1d27def, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/family2/8a75ea00c9514899a3df56f48e53b3a8, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/family2/d7d6a5e416b1445b8cb0374d54319cde, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/family2/f1c0d036f63248b1af0b08ba35c22fea] into tmpdir=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/.tmp, totalSize=25.4 K 2023-03-14 14:55:51,146 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting 3d6bcfffaa92469c8f5b897b97446c03, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678805741888 2023-03-14 14:55:51,147 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting 425a2a56b6e146f8babbd964a1d27def, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678805743770 2023-03-14 14:55:51,147 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting 8a75ea00c9514899a3df56f48e53b3a8, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678805745240 2023-03-14 14:55:51,147 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting d7d6a5e416b1445b8cb0374d54319cde, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678805747125 2023-03-14 14:55:51,148 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting f1c0d036f63248b1af0b08ba35c22fea, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-14 14:55:51,155 INFO [Listener at localhost.localdomain/44261] throttle.PressureAwareThroughputController(145): 82c61abd947e5b78a8c268e9c5cab198#family2#compaction#199 average throughput is 1.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-14 14:55:51,163 INFO [Listener at localhost.localdomain/44261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202303148b2ea34952794847b6fd176a5594b9a9_del 2023-03-14 14:55:51,163 INFO [Listener at localhost.localdomain/44261] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202303148b2ea34952794847b6fd176a5594b9a9_del to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202303148b2ea34952794847b6fd176a5594b9a9_del 2023-03-14 14:55:51,232 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/family1/cd44fd3723bd49988b993096fbef546c, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/family1/b95505fa46ed4a909b5cc6c5ab3114df, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/family1/9104f8775604482baed37291c17754ba, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/family1/d4987168aa3b43fe9c6fdbad0d2a0658, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/family1/1677b7e83c134c4b8a3b1f415d66321a] to archive 2023-03-14 14:55:51,233 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 14:55:51,235 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/family1/cd44fd3723bd49988b993096fbef546c to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/family1/cd44fd3723bd49988b993096fbef546c 2023-03-14 14:55:51,236 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/family1/b95505fa46ed4a909b5cc6c5ab3114df to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/family1/b95505fa46ed4a909b5cc6c5ab3114df 2023-03-14 14:55:51,237 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/family1/9104f8775604482baed37291c17754ba to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/family1/9104f8775604482baed37291c17754ba 2023-03-14 14:55:51,238 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/family1/d4987168aa3b43fe9c6fdbad0d2a0658 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/family1/d4987168aa3b43fe9c6fdbad0d2a0658 2023-03-14 14:55:51,239 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/family1/1677b7e83c134c4b8a3b1f415d66321a to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/family1/1677b7e83c134c4b8a3b1f415d66321a 2023-03-14 14:55:51,587 INFO [Listener at localhost.localdomain/44261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 650ad648401c411fb41fd3e70b3c01ba 2023-03-14 14:55:51,588 DEBUG [Listener at localhost.localdomain/44261] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/.tmp/family2/650ad648401c411fb41fd3e70b3c01ba as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/family2/650ad648401c411fb41fd3e70b3c01ba 2023-03-14 14:55:51,591 INFO [Listener at localhost.localdomain/44261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 650ad648401c411fb41fd3e70b3c01ba 2023-03-14 14:55:51,592 INFO [Listener at localhost.localdomain/44261] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 82c61abd947e5b78a8c268e9c5cab198/family2 of 82c61abd947e5b78a8c268e9c5cab198 into 650ad648401c411fb41fd3e70b3c01ba(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-14 14:55:51,592 DEBUG [Listener at localhost.localdomain/44261] regionserver.HRegion(2289): Compaction status journal for 82c61abd947e5b78a8c268e9c5cab198: 2023-03-14 14:55:51,592 DEBUG [Listener at localhost.localdomain/44261] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-14 14:55:51,592 DEBUG [Listener at localhost.localdomain/44261] regionserver.HStore(1912): 8816b1e503374db245dbd0800d77f3a4/family1 is initiating major compaction (all files) 2023-03-14 14:55:51,593 INFO [Listener at localhost.localdomain/44261] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-14 14:55:51,593 INFO [Listener at localhost.localdomain/44261] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-14 14:55:51,593 INFO [Listener at localhost.localdomain/44261] regionserver.HRegion(2259): Starting compaction of 8816b1e503374db245dbd0800d77f3a4/family1 in testMajorCompactionFromAdmin,2,1678805739734.8816b1e503374db245dbd0800d77f3a4. 2023-03-14 14:55:51,593 INFO [Listener at localhost.localdomain/44261] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/family1/cc7a84b1b9a74ebba0a0ae41641b07a1, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/family1/8028100671fa4feb9110acdd6262f408, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/family1/bd2b17c1a5a34843b67a98a90395a7a9, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/family1/91e7cc21a6c5402cbf2a9e768eb1da75, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/family1/ec523000919640899905d0aef9c52a06] into tmpdir=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/.tmp, totalSize=27.1 K 2023-03-14 14:55:51,594 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting cc7a84b1b9a74ebba0a0ae41641b07a1, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678805741889 2023-03-14 14:55:51,594 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting 8028100671fa4feb9110acdd6262f408, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678805743770 2023-03-14 14:55:51,594 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting bd2b17c1a5a34843b67a98a90395a7a9, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678805745240 2023-03-14 14:55:51,594 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting 91e7cc21a6c5402cbf2a9e768eb1da75, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678805747125 2023-03-14 14:55:51,595 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting ec523000919640899905d0aef9c52a06, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-14 14:55:51,603 INFO [Listener at localhost.localdomain/44261] throttle.PressureAwareThroughputController(145): 8816b1e503374db245dbd0800d77f3a4#family1#compaction#200 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-14 14:55:51,633 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/family2/3d6bcfffaa92469c8f5b897b97446c03, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/family2/425a2a56b6e146f8babbd964a1d27def, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/family2/8a75ea00c9514899a3df56f48e53b3a8, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/family2/d7d6a5e416b1445b8cb0374d54319cde, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/family2/f1c0d036f63248b1af0b08ba35c22fea] to archive 2023-03-14 14:55:51,634 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 14:55:51,635 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/family2/3d6bcfffaa92469c8f5b897b97446c03 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/family2/3d6bcfffaa92469c8f5b897b97446c03 2023-03-14 14:55:51,636 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/family2/425a2a56b6e146f8babbd964a1d27def to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/family2/425a2a56b6e146f8babbd964a1d27def 2023-03-14 14:55:51,637 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/family2/8a75ea00c9514899a3df56f48e53b3a8 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/family2/8a75ea00c9514899a3df56f48e53b3a8 2023-03-14 14:55:51,638 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/family2/d7d6a5e416b1445b8cb0374d54319cde to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/family2/d7d6a5e416b1445b8cb0374d54319cde 2023-03-14 14:55:51,639 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/family2/f1c0d036f63248b1af0b08ba35c22fea to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/family2/f1c0d036f63248b1af0b08ba35c22fea 2023-03-14 14:55:52,035 INFO [Listener at localhost.localdomain/44261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202303146199f658cd344ea481fa181e96ad0965_del 2023-03-14 14:55:52,035 INFO [Listener at localhost.localdomain/44261] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202303146199f658cd344ea481fa181e96ad0965_del to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202303146199f658cd344ea481fa181e96ad0965_del 2023-03-14 14:55:52,888 INFO [Listener at localhost.localdomain/44261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0184312763814660a356c47329688a08 2023-03-14 14:55:52,889 DEBUG [Listener at localhost.localdomain/44261] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/.tmp/family1/0184312763814660a356c47329688a08 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/family1/0184312763814660a356c47329688a08 2023-03-14 14:55:52,907 INFO [Listener at localhost.localdomain/44261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0184312763814660a356c47329688a08 2023-03-14 14:55:52,908 INFO [Listener at localhost.localdomain/44261] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 8816b1e503374db245dbd0800d77f3a4/family1 of 8816b1e503374db245dbd0800d77f3a4 into 0184312763814660a356c47329688a08(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-14 14:55:52,908 DEBUG [Listener at localhost.localdomain/44261] regionserver.HRegion(2289): Compaction status journal for 8816b1e503374db245dbd0800d77f3a4: 2023-03-14 14:55:52,908 DEBUG [Listener at localhost.localdomain/44261] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-14 14:55:52,908 DEBUG [Listener at localhost.localdomain/44261] regionserver.HStore(1912): 8816b1e503374db245dbd0800d77f3a4/family2 is initiating major compaction (all files) 2023-03-14 14:55:52,908 INFO [Listener at localhost.localdomain/44261] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-14 14:55:52,908 INFO [Listener at localhost.localdomain/44261] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-14 14:55:52,908 INFO [Listener at localhost.localdomain/44261] regionserver.HRegion(2259): Starting compaction of 8816b1e503374db245dbd0800d77f3a4/family2 in testMajorCompactionFromAdmin,2,1678805739734.8816b1e503374db245dbd0800d77f3a4. 2023-03-14 14:55:52,908 INFO [Listener at localhost.localdomain/44261] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/family2/319b5aee2a454fcb9bcf0562d3091f65, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/family2/f5782a179bac48cf853cbf2e73d6ae01, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/family2/00d363fc1a174bd68a6589893c6892fd, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/family2/9a2bb8e6f9024616b55b8e1e59f9b1de, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/family2/38cb4f93b424429f9809757cf48761d6] into tmpdir=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/.tmp, totalSize=25.4 K 2023-03-14 14:55:52,909 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting 319b5aee2a454fcb9bcf0562d3091f65, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678805741889 2023-03-14 14:55:52,909 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting f5782a179bac48cf853cbf2e73d6ae01, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678805743770 2023-03-14 14:55:52,909 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting 00d363fc1a174bd68a6589893c6892fd, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678805745240 2023-03-14 14:55:52,909 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting 9a2bb8e6f9024616b55b8e1e59f9b1de, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678805747125 2023-03-14 14:55:52,910 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting 38cb4f93b424429f9809757cf48761d6, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-14 14:55:52,917 INFO [Listener at localhost.localdomain/44261] throttle.PressureAwareThroughputController(145): 8816b1e503374db245dbd0800d77f3a4#family2#compaction#201 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-14 14:55:52,935 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/family1/cc7a84b1b9a74ebba0a0ae41641b07a1, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/family1/8028100671fa4feb9110acdd6262f408, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/family1/bd2b17c1a5a34843b67a98a90395a7a9, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/family1/91e7cc21a6c5402cbf2a9e768eb1da75, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/family1/ec523000919640899905d0aef9c52a06] to archive 2023-03-14 14:55:52,935 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 14:55:52,937 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/family1/cc7a84b1b9a74ebba0a0ae41641b07a1 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/family1/cc7a84b1b9a74ebba0a0ae41641b07a1 2023-03-14 14:55:52,937 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/family1/8028100671fa4feb9110acdd6262f408 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/family1/8028100671fa4feb9110acdd6262f408 2023-03-14 14:55:52,938 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/family1/bd2b17c1a5a34843b67a98a90395a7a9 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/family1/bd2b17c1a5a34843b67a98a90395a7a9 2023-03-14 14:55:52,939 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/family1/91e7cc21a6c5402cbf2a9e768eb1da75 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/family1/91e7cc21a6c5402cbf2a9e768eb1da75 2023-03-14 14:55:52,940 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/family1/ec523000919640899905d0aef9c52a06 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/family1/ec523000919640899905d0aef9c52a06 2023-03-14 14:55:53,323 INFO [Listener at localhost.localdomain/44261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230314affaeb4487bb43fe8b6ed6414762832e_del 2023-03-14 14:55:53,323 INFO [Listener at localhost.localdomain/44261] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230314affaeb4487bb43fe8b6ed6414762832e_del to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20230314affaeb4487bb43fe8b6ed6414762832e_del 2023-03-14 14:55:53,736 INFO [Listener at localhost.localdomain/44261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 68d246fda6e14baa805f3899d5e71af7 2023-03-14 14:55:53,737 DEBUG [Listener at localhost.localdomain/44261] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/.tmp/family2/68d246fda6e14baa805f3899d5e71af7 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/family2/68d246fda6e14baa805f3899d5e71af7 2023-03-14 14:55:53,740 INFO [Listener at localhost.localdomain/44261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 68d246fda6e14baa805f3899d5e71af7 2023-03-14 14:55:53,741 INFO [Listener at localhost.localdomain/44261] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 8816b1e503374db245dbd0800d77f3a4/family2 of 8816b1e503374db245dbd0800d77f3a4 into 68d246fda6e14baa805f3899d5e71af7(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-14 14:55:53,741 DEBUG [Listener at localhost.localdomain/44261] regionserver.HRegion(2289): Compaction status journal for 8816b1e503374db245dbd0800d77f3a4: 2023-03-14 14:55:53,741 DEBUG [Listener at localhost.localdomain/44261] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-14 14:55:53,741 DEBUG [Listener at localhost.localdomain/44261] regionserver.HStore(1912): cfc8b82e17760331b0d59f661140bb28/family1 is initiating major compaction (all files) 2023-03-14 14:55:53,741 INFO [Listener at localhost.localdomain/44261] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-14 14:55:53,742 INFO [Listener at localhost.localdomain/44261] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-14 14:55:53,742 INFO [Listener at localhost.localdomain/44261] regionserver.HRegion(2259): Starting compaction of cfc8b82e17760331b0d59f661140bb28/family1 in testMajorCompactionFromAdmin,1,1678805739734.cfc8b82e17760331b0d59f661140bb28. 2023-03-14 14:55:53,742 INFO [Listener at localhost.localdomain/44261] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/family1/f08b72e8a07943a1881672af3366c62f, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/family1/6cb3cd51ea5848c38e748455bc078fc3, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/family1/bddb243d613b4cceb7a55d1cc69a2931, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/family1/8082e757b7a9438d99eadbcdcc4c3f51, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/family1/aaeb1b470b2240e7871c58afb133cc48] into tmpdir=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/.tmp, totalSize=27.1 K 2023-03-14 14:55:53,743 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting f08b72e8a07943a1881672af3366c62f, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678805741888 2023-03-14 14:55:53,743 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting 6cb3cd51ea5848c38e748455bc078fc3, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678805743770 2023-03-14 14:55:53,743 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting bddb243d613b4cceb7a55d1cc69a2931, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678805745240 2023-03-14 14:55:53,743 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting 8082e757b7a9438d99eadbcdcc4c3f51, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678805747125 2023-03-14 14:55:53,744 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting aaeb1b470b2240e7871c58afb133cc48, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-14 14:55:53,751 INFO [Listener at localhost.localdomain/44261] throttle.PressureAwareThroughputController(145): cfc8b82e17760331b0d59f661140bb28#family1#compaction#202 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-14 14:55:53,791 INFO [Listener at localhost.localdomain/44261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230314a92c65f3b8d64c26b8caf3571086b4db_del 2023-03-14 14:55:53,791 INFO [Listener at localhost.localdomain/44261] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230314a92c65f3b8d64c26b8caf3571086b4db_del to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230314a92c65f3b8d64c26b8caf3571086b4db_del 2023-03-14 14:55:53,833 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/family2/319b5aee2a454fcb9bcf0562d3091f65, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/family2/f5782a179bac48cf853cbf2e73d6ae01, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/family2/00d363fc1a174bd68a6589893c6892fd, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/family2/9a2bb8e6f9024616b55b8e1e59f9b1de, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/family2/38cb4f93b424429f9809757cf48761d6] to archive 2023-03-14 14:55:53,834 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 14:55:53,835 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/family2/319b5aee2a454fcb9bcf0562d3091f65 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/family2/319b5aee2a454fcb9bcf0562d3091f65 2023-03-14 14:55:53,836 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/family2/f5782a179bac48cf853cbf2e73d6ae01 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/family2/f5782a179bac48cf853cbf2e73d6ae01 2023-03-14 14:55:53,837 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/family2/00d363fc1a174bd68a6589893c6892fd to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/family2/00d363fc1a174bd68a6589893c6892fd 2023-03-14 14:55:53,838 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/family2/9a2bb8e6f9024616b55b8e1e59f9b1de to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/family2/9a2bb8e6f9024616b55b8e1e59f9b1de 2023-03-14 14:55:53,839 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/family2/38cb4f93b424429f9809757cf48761d6 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/family2/38cb4f93b424429f9809757cf48761d6 2023-03-14 14:55:54,648 INFO [Listener at localhost.localdomain/44261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e69ef97ea6d4433e8b6b40de4c7a4db6 2023-03-14 14:55:54,648 DEBUG [Listener at localhost.localdomain/44261] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/.tmp/family1/e69ef97ea6d4433e8b6b40de4c7a4db6 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/family1/e69ef97ea6d4433e8b6b40de4c7a4db6 2023-03-14 14:55:54,673 INFO [Listener at localhost.localdomain/44261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e69ef97ea6d4433e8b6b40de4c7a4db6 2023-03-14 14:55:54,674 INFO [Listener at localhost.localdomain/44261] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in cfc8b82e17760331b0d59f661140bb28/family1 of cfc8b82e17760331b0d59f661140bb28 into e69ef97ea6d4433e8b6b40de4c7a4db6(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-03-14 14:55:54,674 DEBUG [Listener at localhost.localdomain/44261] regionserver.HRegion(2289): Compaction status journal for cfc8b82e17760331b0d59f661140bb28: 2023-03-14 14:55:54,675 DEBUG [Listener at localhost.localdomain/44261] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-03-14 14:55:54,675 DEBUG [Listener at localhost.localdomain/44261] regionserver.HStore(1912): cfc8b82e17760331b0d59f661140bb28/family2 is initiating major compaction (all files) 2023-03-14 14:55:54,675 INFO [Listener at localhost.localdomain/44261] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-03-14 14:55:54,675 INFO [Listener at localhost.localdomain/44261] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-03-14 14:55:54,675 INFO [Listener at localhost.localdomain/44261] regionserver.HRegion(2259): Starting compaction of cfc8b82e17760331b0d59f661140bb28/family2 in testMajorCompactionFromAdmin,1,1678805739734.cfc8b82e17760331b0d59f661140bb28. 2023-03-14 14:55:54,675 INFO [Listener at localhost.localdomain/44261] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/family2/c586011dfa0745ecade85cb2474b0b01, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/family2/9cbeb089a23a4f84bfcf883ed185024a, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/family2/3c98260b48a444f484a5f4ae2050602d, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/family2/e320b9760a2b44e39ae52818a8d8b96e, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/family2/ac9eb9a12f084672ba2db678edfd2d90] into tmpdir=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/.tmp, totalSize=25.4 K 2023-03-14 14:55:54,676 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting c586011dfa0745ecade85cb2474b0b01, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1678805741888 2023-03-14 14:55:54,676 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting 9cbeb089a23a4f84bfcf883ed185024a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1678805743770 2023-03-14 14:55:54,676 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting 3c98260b48a444f484a5f4ae2050602d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1678805745240 2023-03-14 14:55:54,677 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting e320b9760a2b44e39ae52818a8d8b96e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1678805747125 2023-03-14 14:55:54,678 DEBUG [Listener at localhost.localdomain/44261] compactions.Compactor(207): Compacting ac9eb9a12f084672ba2db678edfd2d90, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-03-14 14:55:54,700 INFO [Listener at localhost.localdomain/44261] throttle.PressureAwareThroughputController(145): cfc8b82e17760331b0d59f661140bb28#family2#compaction#203 average throughput is 0.08 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-03-14 14:55:54,738 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/family1/f08b72e8a07943a1881672af3366c62f, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/family1/6cb3cd51ea5848c38e748455bc078fc3, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/family1/bddb243d613b4cceb7a55d1cc69a2931, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/family1/8082e757b7a9438d99eadbcdcc4c3f51, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/family1/aaeb1b470b2240e7871c58afb133cc48] to archive 2023-03-14 14:55:54,739 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 14:55:54,741 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/family1/f08b72e8a07943a1881672af3366c62f to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/family1/f08b72e8a07943a1881672af3366c62f 2023-03-14 14:55:54,742 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/family1/6cb3cd51ea5848c38e748455bc078fc3 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/family1/6cb3cd51ea5848c38e748455bc078fc3 2023-03-14 14:55:54,744 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/family1/bddb243d613b4cceb7a55d1cc69a2931 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/family1/bddb243d613b4cceb7a55d1cc69a2931 2023-03-14 14:55:54,745 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/family1/8082e757b7a9438d99eadbcdcc4c3f51 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/family1/8082e757b7a9438d99eadbcdcc4c3f51 2023-03-14 14:55:54,746 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/family1/aaeb1b470b2240e7871c58afb133cc48 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/family1/aaeb1b470b2240e7871c58afb133cc48 2023-03-14 14:55:55,112 INFO [Listener at localhost.localdomain/44261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230314737de8e4621c49f3b30767e7b60120fc_del 2023-03-14 14:55:55,112 INFO [Listener at localhost.localdomain/44261] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230314737de8e4621c49f3b30767e7b60120fc_del to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20230314737de8e4621c49f3b30767e7b60120fc_del 2023-03-14 14:55:55,927 INFO [Listener at localhost.localdomain/44261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for afd8d0182b80462596521994ccff710c 2023-03-14 14:55:55,927 DEBUG [Listener at localhost.localdomain/44261] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/.tmp/family2/afd8d0182b80462596521994ccff710c as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/family2/afd8d0182b80462596521994ccff710c 2023-03-14 14:55:55,931 INFO [Listener at localhost.localdomain/44261] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for afd8d0182b80462596521994ccff710c 2023-03-14 14:55:55,932 INFO [Listener at localhost.localdomain/44261] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in cfc8b82e17760331b0d59f661140bb28/family2 of cfc8b82e17760331b0d59f661140bb28 into afd8d0182b80462596521994ccff710c(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-03-14 14:55:55,932 DEBUG [Listener at localhost.localdomain/44261] regionserver.HRegion(2289): Compaction status journal for cfc8b82e17760331b0d59f661140bb28: 2023-03-14 14:55:55,933 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/family2/c586011dfa0745ecade85cb2474b0b01, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/family2/9cbeb089a23a4f84bfcf883ed185024a, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/family2/3c98260b48a444f484a5f4ae2050602d, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/family2/e320b9760a2b44e39ae52818a8d8b96e, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/family2/ac9eb9a12f084672ba2db678edfd2d90] to archive 2023-03-14 14:55:55,934 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 14:55:55,935 DEBUG [Listener at localhost.localdomain/44261] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-14 14:55:55,935 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/family2/c586011dfa0745ecade85cb2474b0b01 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/family2/c586011dfa0745ecade85cb2474b0b01 2023-03-14 14:55:55,936 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/family2/9cbeb089a23a4f84bfcf883ed185024a to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/family2/9cbeb089a23a4f84bfcf883ed185024a 2023-03-14 14:55:55,937 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/family2/3c98260b48a444f484a5f4ae2050602d to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/family2/3c98260b48a444f484a5f4ae2050602d 2023-03-14 14:55:55,938 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/family2/e320b9760a2b44e39ae52818a8d8b96e to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/family2/e320b9760a2b44e39ae52818a8d8b96e 2023-03-14 14:55:55,939 DEBUG [Listener at localhost.localdomain/44261] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-14 14:55:55,939 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/family2/ac9eb9a12f084672ba2db678edfd2d90 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/family2/ac9eb9a12f084672ba2db678edfd2d90 2023-03-14 14:55:55,943 DEBUG [Listener at localhost.localdomain/44261] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-14 14:55:55,943 DEBUG [Listener at localhost.localdomain/44261] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-14 14:55:55,947 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=38031] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xE5\xE8\xA7\xCD\xF5\xB9;\xC6eV&\x923\x89;\xF1"\x10\xD0=0C{\xB8*\xF6\xB8\xA7W\x0D\x91%M\x9B*\x10\xE8\x1E\xA0x+\x84\xAD!\x97O\xA2\xC5\xAAS\x01#2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testMajorCompactionFromAdmin 2023-03-14 14:55:55,975 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] procedure2.ProcedureExecutor(1029): Stored pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-03-14 14:55:55,976 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-03-14 14:55:55,977 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-14 14:55:55,977 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=123, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1678806355977 2023-03-14 14:55:55,977 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-03-14 14:55:56,070 DEBUG [regionserver/jenkins-hbase20:0.Chore.2] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-03-14 14:55:56,312 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testMajorCompactionFromAdmin' and column 'family1' 2023-03-14 14:55:56,333 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202303148f388b01f0ed41bb94b033d5d81d9345_del 2023-03-14 14:55:56,352 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230314a92c65f3b8d64c26b8caf3571086b4db_del 2023-03-14 14:55:56,378 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202303146199f658cd344ea481fa181e96ad0965_del 2023-03-14 14:55:56,378 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testMajorCompactionFromAdmin' column='family1' 2023-03-14 14:55:56,378 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] zookeeper.ReadOnlyZKClient(139): Connect 0x6b5208ee to 127.0.0.1:50211 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-03-14 14:55:56,384 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4aad1179, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-03-14 14:55:56,385 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230314 for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-14 14:55:56,956 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230314d869bbe97310404b9c8d6b37e1ead449 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230314d869bbe97310404b9c8d6b37e1ead449 2023-03-14 14:55:56,957 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230314 table='testMajorCompactionFromAdmin' column='family1' 2023-03-14 14:55:56,972 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-03-14 14:55:56,974 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:55698, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-03-14 14:55:56,983 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-03-14 14:55:56,985 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:38880, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-03-14 14:55:57,010 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230314/family1/8b28a2495b50411992875845ba01e9ba first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-03-14 14:55:57,010 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionFromAdmin,,1678805739734.82c61abd947e5b78a8c268e9c5cab198., hostname=jenkins-hbase20.apache.org,41317,1678805580877, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230314/family1/8b28a2495b50411992875845ba01e9ba}] 2023-03-14 14:55:57,016 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230314/family1/8b28a2495b50411992875845ba01e9ba for inclusion in 82c61abd947e5b78a8c268e9c5cab198/family1 2023-03-14 14:55:57,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-03-14 14:55:57,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HStore(777): Region bounds: first= last=1 2023-03-14 14:55:57,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HRegion(2446): Flush status journal for 82c61abd947e5b78a8c268e9c5cab198: 2023-03-14 14:55:57,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230314/family1/8b28a2495b50411992875845ba01e9ba to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionFromAdmin__6oh894nbklmus3sadsqgvjafc6frornrapun286mnpqn29f8ut4kucdu04ajkfa0/family1/8b28a2495b50411992875845ba01e9ba 2023-03-14 14:55:57,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionFromAdmin__6oh894nbklmus3sadsqgvjafc6frornrapun286mnpqn29f8ut4kucdu04ajkfa0/family1/8b28a2495b50411992875845ba01e9ba as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/family1/b0345d2489f1498b9c8e977d40879ea2_SeqId_28_ 2023-03-14 14:55:57,038 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionFromAdmin__6oh894nbklmus3sadsqgvjafc6frornrapun286mnpqn29f8ut4kucdu04ajkfa0/family1/8b28a2495b50411992875845ba01e9ba into 82c61abd947e5b78a8c268e9c5cab198/family1 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/family1/b0345d2489f1498b9c8e977d40879ea2_SeqId_28_ - updating store file list. 2023-03-14 14:55:57,059 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/family1/b0345d2489f1498b9c8e977d40879ea2_SeqId_28_ into 82c61abd947e5b78a8c268e9c5cab198/family1 2023-03-14 14:55:57,059 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionFromAdmin__6oh894nbklmus3sadsqgvjafc6frornrapun286mnpqn29f8ut4kucdu04ajkfa0/family1/8b28a2495b50411992875845ba01e9ba into 82c61abd947e5b78a8c268e9c5cab198/family1 (new location: hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/family1/b0345d2489f1498b9c8e977d40879ea2_SeqId_28_) 2023-03-14 14:55:57,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionFromAdmin__6oh894nbklmus3sadsqgvjafc6frornrapun286mnpqn29f8ut4kucdu04ajkfa0/family1/8b28a2495b50411992875845ba01e9ba 2023-03-14 14:55:57,061 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230314 table='testMajorCompactionFromAdmin' column='family1' 2023-03-14 14:55:57,062 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 14:55:57,063 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023031423c4713ef7064dcbb7f23e6527f3737d to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023031423c4713ef7064dcbb7f23e6527f3737d 2023-03-14 14:55:57,064 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230314877296c125784552a3d1cec4a53d8f0c to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230314877296c125784552a3d1cec4a53d8f0c 2023-03-14 14:55:57,064 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230314966ff63ef6fe4f35a3e52db61d251038 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230314966ff63ef6fe4f35a3e52db61d251038 2023-03-14 14:55:57,065 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230314b1f9190c85784ca6962d0ad00ba998f9 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230314b1f9190c85784ca6962d0ad00ba998f9 2023-03-14 14:55:57,065 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-03-14 14:55:57,065 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230314' 2023-03-14 14:55:57,066 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230314 for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-14 14:55:57,066 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230314 for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-14 14:55:57,417 DEBUG [regionserver/jenkins-hbase20:0.Chore.2] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-03-14 14:55:58,007 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230314380eb0bb9f944fab8128384c59c27255 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230314380eb0bb9f944fab8128384c59c27255 2023-03-14 14:55:58,008 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230314 table='testMajorCompactionFromAdmin' column='family1' 2023-03-14 14:55:58,044 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230314/family1/55686d342d6d466cac6e5a6623385844 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-03-14 14:55:58,045 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionFromAdmin,1,1678805739734.cfc8b82e17760331b0d59f661140bb28., hostname=jenkins-hbase20.apache.org,41317,1678805580877, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230314/family1/55686d342d6d466cac6e5a6623385844}] 2023-03-14 14:55:58,047 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230314/family1/55686d342d6d466cac6e5a6623385844 for inclusion in cfc8b82e17760331b0d59f661140bb28/family1 2023-03-14 14:55:58,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-03-14 14:55:58,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HStore(777): Region bounds: first=1 last=2 2023-03-14 14:55:58,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HRegion(2446): Flush status journal for cfc8b82e17760331b0d59f661140bb28: 2023-03-14 14:55:58,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230314/family1/55686d342d6d466cac6e5a6623385844 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionFromAdmin__9btpalqae7utoefol9onv8nepcgdqdhkiv4mmhji6nnspvkbklbogbdke62ko57u/family1/55686d342d6d466cac6e5a6623385844 2023-03-14 14:55:58,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionFromAdmin__9btpalqae7utoefol9onv8nepcgdqdhkiv4mmhji6nnspvkbklbogbdke62ko57u/family1/55686d342d6d466cac6e5a6623385844 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/family1/1b4aaa608368434c89cf9eba47aa6b23_SeqId_28_ 2023-03-14 14:55:58,071 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionFromAdmin__9btpalqae7utoefol9onv8nepcgdqdhkiv4mmhji6nnspvkbklbogbdke62ko57u/family1/55686d342d6d466cac6e5a6623385844 into cfc8b82e17760331b0d59f661140bb28/family1 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/family1/1b4aaa608368434c89cf9eba47aa6b23_SeqId_28_ - updating store file list. 2023-03-14 14:55:58,089 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/family1/1b4aaa608368434c89cf9eba47aa6b23_SeqId_28_ into cfc8b82e17760331b0d59f661140bb28/family1 2023-03-14 14:55:58,089 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionFromAdmin__9btpalqae7utoefol9onv8nepcgdqdhkiv4mmhji6nnspvkbklbogbdke62ko57u/family1/55686d342d6d466cac6e5a6623385844 into cfc8b82e17760331b0d59f661140bb28/family1 (new location: hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/family1/1b4aaa608368434c89cf9eba47aa6b23_SeqId_28_) 2023-03-14 14:55:58,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionFromAdmin__9btpalqae7utoefol9onv8nepcgdqdhkiv4mmhji6nnspvkbklbogbdke62ko57u/family1/55686d342d6d466cac6e5a6623385844 2023-03-14 14:55:58,091 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230314 table='testMajorCompactionFromAdmin' column='family1' 2023-03-14 14:55:58,091 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 14:55:58,092 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202303142a77de1dad5a499db61b5b485c86bab1 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202303142a77de1dad5a499db61b5b485c86bab1 2023-03-14 14:55:58,093 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230314311262999fa54ff78a75566744b5eff9 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230314311262999fa54ff78a75566744b5eff9 2023-03-14 14:55:58,094 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230314bd97bf0cc0bf42fda7c3a0ce6162d790 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230314bd97bf0cc0bf42fda7c3a0ce6162d790 2023-03-14 14:55:58,094 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230314f2696bbbe76d42a997854dc55646fc96 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230314f2696bbbe76d42a997854dc55646fc96 2023-03-14 14:55:58,094 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-03-14 14:55:58,094 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230314' 2023-03-14 14:55:58,095 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230314 for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-14 14:55:58,095 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230314 for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-14 14:55:58,624 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023031433f5ca542b0f47abb050749d50cba642 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023031433f5ca542b0f47abb050749d50cba642 2023-03-14 14:55:58,625 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230314 table='testMajorCompactionFromAdmin' column='family1' 2023-03-14 14:55:58,632 DEBUG [regionserver/jenkins-hbase20:0.Chore.2] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-03-14 14:55:58,700 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230314/family1/1941754446354e2d98720f9ceac97522 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-03-14 14:55:58,701 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionFromAdmin,2,1678805739734.8816b1e503374db245dbd0800d77f3a4., hostname=jenkins-hbase20.apache.org,41317,1678805580877, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230314/family1/1941754446354e2d98720f9ceac97522}] 2023-03-14 14:55:58,704 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230314/family1/1941754446354e2d98720f9ceac97522 for inclusion in 8816b1e503374db245dbd0800d77f3a4/family1 2023-03-14 14:55:58,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-03-14 14:55:58,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HStore(777): Region bounds: first=2 last= 2023-03-14 14:55:58,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HRegion(2446): Flush status journal for 8816b1e503374db245dbd0800d77f3a4: 2023-03-14 14:55:58,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230314/family1/1941754446354e2d98720f9ceac97522 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionFromAdmin__q28hkrgt185onlp226nin4ultjjf7khqesknmivq9lf42p4b55fqbrj24fpvrel4/family1/1941754446354e2d98720f9ceac97522 2023-03-14 14:55:58,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionFromAdmin__q28hkrgt185onlp226nin4ultjjf7khqesknmivq9lf42p4b55fqbrj24fpvrel4/family1/1941754446354e2d98720f9ceac97522 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/family1/0829c208dd7c4f38bcc8d770e3483ee6_SeqId_28_ 2023-03-14 14:55:58,742 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionFromAdmin__q28hkrgt185onlp226nin4ultjjf7khqesknmivq9lf42p4b55fqbrj24fpvrel4/family1/1941754446354e2d98720f9ceac97522 into 8816b1e503374db245dbd0800d77f3a4/family1 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/family1/0829c208dd7c4f38bcc8d770e3483ee6_SeqId_28_ - updating store file list. 2023-03-14 14:55:58,782 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/family1/0829c208dd7c4f38bcc8d770e3483ee6_SeqId_28_ into 8816b1e503374db245dbd0800d77f3a4/family1 2023-03-14 14:55:58,783 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionFromAdmin__q28hkrgt185onlp226nin4ultjjf7khqesknmivq9lf42p4b55fqbrj24fpvrel4/family1/1941754446354e2d98720f9ceac97522 into 8816b1e503374db245dbd0800d77f3a4/family1 (new location: hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/family1/0829c208dd7c4f38bcc8d770e3483ee6_SeqId_28_) 2023-03-14 14:55:58,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41317] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/staging/jenkins__testMajorCompactionFromAdmin__q28hkrgt185onlp226nin4ultjjf7khqesknmivq9lf42p4b55fqbrj24fpvrel4/family1/1941754446354e2d98720f9ceac97522 2023-03-14 14:55:58,786 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230314 table='testMajorCompactionFromAdmin' column='family1' 2023-03-14 14:55:58,787 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 14:55:58,790 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023031410e4812a0c71456c8600fa31a6148393 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023031410e4812a0c71456c8600fa31a6148393 2023-03-14 14:55:58,793 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230314375d864a54e2443d8417037f22244eb4 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230314375d864a54e2443d8417037f22244eb4 2023-03-14 14:55:58,799 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202303144afa05986f5c409eb60b961cbe80da1f to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202303144afa05986f5c409eb60b961cbe80da1f 2023-03-14 14:55:58,801 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023031494c40f16bf31419892e14ad0baab0674 to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023031494c40f16bf31419892e14ad0baab0674 2023-03-14 14:55:58,801 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-03-14 14:55:58,801 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230314' 2023-03-14 14:55:58,802 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230314 for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-14 14:55:58,802 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testMajorCompactionFromAdmin' column='family1' 2023-03-14 14:55:58,802 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testMajorCompactionFromAdmin' and column='family1' 2023-03-14 14:55:58,802 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] compactions.PartitionedMobCompactor(367): [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202303148f388b01f0ed41bb94b033d5d81d9345_del] 2023-03-14 14:55:58,802 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 14:55:58,805 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202303148f388b01f0ed41bb94b033d5d81d9345_del to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202303148f388b01f0ed41bb94b033d5d81d9345_del 2023-03-14 14:55:58,805 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-03-14 14:55:58,805 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] compactions.PartitionedMobCompactor(367): [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230314a92c65f3b8d64c26b8caf3571086b4db_del] 2023-03-14 14:55:58,806 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 14:55:58,807 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230314a92c65f3b8d64c26b8caf3571086b4db_del to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230314a92c65f3b8d64c26b8caf3571086b4db_del 2023-03-14 14:55:58,807 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-03-14 14:55:58,807 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] compactions.PartitionedMobCompactor(367): [hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202303146199f658cd344ea481fa181e96ad0965_del] 2023-03-14 14:55:58,810 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] backup.HFileArchiver(360): Archiving compacted files. 2023-03-14 14:55:58,812 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202303146199f658cd344ea481fa181e96ad0965_del to hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202303146199f658cd344ea481fa181e96ad0965_del 2023-03-14 14:55:58,812 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-03-14 14:55:58,812 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1678805585929] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-03-14 14:55:58,814 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=123, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-03-14 14:55:58,816 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=123, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE in 2.8390 sec 2023-03-14 14:55:58,827 DEBUG [Listener at localhost.localdomain/44261] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-14 14:55:58,830 DEBUG [Listener at localhost.localdomain/44261] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-14 14:55:58,838 DEBUG [Listener at localhost.localdomain/44261] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-03-14 14:55:58,839 DEBUG [Listener at localhost.localdomain/44261] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-03-14 14:55:58,847 INFO [Listener at localhost.localdomain/44261] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-03-14 14:55:58,901 INFO [Listener at localhost.localdomain/44261] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=246 (was 253), OpenFileDescriptor=634 (was 641), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=170 (was 145) - SystemLoadAverage LEAK? -, ProcessCount=166 (was 166), AvailableMemoryMB=13232 (was 13870) 2023-03-14 14:55:58,901 DEBUG [Listener at localhost.localdomain/44261] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1f820396 to 127.0.0.1:50211 2023-03-14 14:55:58,902 DEBUG [Listener at localhost.localdomain/44261] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-14 14:55:58,902 INFO [Listener at localhost.localdomain/44261] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-03-14 14:55:58,902 INFO [Listener at localhost.localdomain/44261] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-03-14 14:55:58,902 DEBUG [Listener at localhost.localdomain/44261] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x11ea4006 to 127.0.0.1:50211 2023-03-14 14:55:58,902 DEBUG [Listener at localhost.localdomain/44261] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-14 14:55:58,902 DEBUG [Listener at localhost.localdomain/44261] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-03-14 14:55:58,902 DEBUG [Listener at localhost.localdomain/44261] util.JVMClusterUtil(257): Found active master hash=1945012778, stopped=false 2023-03-14 14:55:58,902 INFO [Listener at localhost.localdomain/44261] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase20.apache.org,38031,1678805579674 2023-03-14 14:55:58,906 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-03-14 14:55:58,907 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-03-14 14:55:58,907 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-03-14 14:55:58,907 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-14 14:55:58,907 INFO [Listener at localhost.localdomain/44261] procedure2.ProcedureExecutor(629): Stopping 2023-03-14 14:55:58,907 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-03-14 14:55:58,909 DEBUG [Listener at localhost.localdomain/44261] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x16fac52d to 127.0.0.1:50211 2023-03-14 14:55:58,909 DEBUG [Listener at localhost.localdomain/44261] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-14 14:55:58,910 INFO [Listener at localhost.localdomain/44261] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,41317,1678805580877' ***** 2023-03-14 14:55:58,914 INFO [Listener at localhost.localdomain/44261] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-03-14 14:55:58,914 INFO [RS:0;jenkins-hbase20:41317] regionserver.HeapMemoryManager(220): Stopping 2023-03-14 14:55:58,914 INFO [RS:0;jenkins-hbase20:41317] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-03-14 14:55:58,915 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-03-14 14:55:58,915 INFO [RS:0;jenkins-hbase20:41317] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-03-14 14:55:58,915 INFO [RS:0;jenkins-hbase20:41317] regionserver.HRegionServer(3304): Received CLOSE for 67d879ca35c5695ef1b3dd5a65dac816 2023-03-14 14:55:58,915 INFO [RS:0;jenkins-hbase20:41317] regionserver.HRegionServer(3304): Received CLOSE for 10546b400d27bbc83495bff794d39660 2023-03-14 14:55:58,915 INFO [RS:0;jenkins-hbase20:41317] regionserver.HRegionServer(3304): Received CLOSE for 82c61abd947e5b78a8c268e9c5cab198 2023-03-14 14:55:58,915 INFO [RS:0;jenkins-hbase20:41317] regionserver.HRegionServer(3304): Received CLOSE for 3ea13ff804537f3e856a240e0067a94c 2023-03-14 14:55:58,915 INFO [RS:0;jenkins-hbase20:41317] regionserver.HRegionServer(3304): Received CLOSE for 8816b1e503374db245dbd0800d77f3a4 2023-03-14 14:55:58,915 INFO [RS:0;jenkins-hbase20:41317] regionserver.HRegionServer(3304): Received CLOSE for d03921af574c9e368e124258e08ab95d 2023-03-14 14:55:58,915 INFO [RS:0;jenkins-hbase20:41317] regionserver.HRegionServer(3304): Received CLOSE for 46b57114435577599b693b836e0ad8d2 2023-03-14 14:55:58,916 INFO [RS:0;jenkins-hbase20:41317] regionserver.HRegionServer(3304): Received CLOSE for 984e5359c7c1d404d5a6dab33d5d90f1 2023-03-14 14:55:58,916 INFO [RS:0;jenkins-hbase20:41317] regionserver.HRegionServer(3304): Received CLOSE for 4fc16beb64e446f8e20e521dacdaf408 2023-03-14 14:55:58,916 INFO [RS:0;jenkins-hbase20:41317] regionserver.HRegionServer(3304): Received CLOSE for 4e01724a8ecff4aa30dbfa9d68c1991a 2023-03-14 14:55:58,916 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 67d879ca35c5695ef1b3dd5a65dac816, disabling compactions & flushes 2023-03-14 14:55:58,916 INFO [RS:0;jenkins-hbase20:41317] regionserver.HRegionServer(3304): Received CLOSE for 1b57993c9af4fc1b678650e0db6b7634 2023-03-14 14:55:58,916 INFO [RS:0;jenkins-hbase20:41317] regionserver.HRegionServer(3304): Received CLOSE for 3b6ac335f3eded6c9d62899b5ba0c2df 2023-03-14 14:55:58,916 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1678805726774.67d879ca35c5695ef1b3dd5a65dac816. 2023-03-14 14:55:58,916 INFO [RS:0;jenkins-hbase20:41317] regionserver.HRegionServer(3304): Received CLOSE for 7eb84d1cb8ce303dd656f6348c25f0e3 2023-03-14 14:55:58,916 INFO [RS:0;jenkins-hbase20:41317] regionserver.HRegionServer(3304): Received CLOSE for 14e9cbacd99b2cc16b477e8d2c9c88a4 2023-03-14 14:55:58,916 INFO [RS:0;jenkins-hbase20:41317] regionserver.HRegionServer(3304): Received CLOSE for 541dfbe822716da662f3a573a64aa05f 2023-03-14 14:55:58,916 INFO [RS:0;jenkins-hbase20:41317] regionserver.HRegionServer(3304): Received CLOSE for b108573ed4edc7c6723ae22ab3b01c14 2023-03-14 14:55:58,916 INFO [RS:0;jenkins-hbase20:41317] regionserver.HRegionServer(3304): Received CLOSE for 0b22b7f42a887fbc05e1153fe076072e 2023-03-14 14:55:58,916 INFO [RS:0;jenkins-hbase20:41317] regionserver.HRegionServer(3304): Received CLOSE for 97b71e93d23ff8810dbd42b157c10dd3 2023-03-14 14:55:58,916 INFO [RS:0;jenkins-hbase20:41317] regionserver.HRegionServer(3304): Received CLOSE for 81d1d1d671b72bf2cfae45402ba07d68 2023-03-14 14:55:58,916 INFO [RS:0;jenkins-hbase20:41317] regionserver.HRegionServer(3304): Received CLOSE for cfc8b82e17760331b0d59f661140bb28 2023-03-14 14:55:58,916 INFO [RS:0;jenkins-hbase20:41317] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:55:58,916 DEBUG [RS:0;jenkins-hbase20:41317] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2eff5db8 to 127.0.0.1:50211 2023-03-14 14:55:58,916 DEBUG [RS:0;jenkins-hbase20:41317] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-14 14:55:58,916 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1678805726774.67d879ca35c5695ef1b3dd5a65dac816. 2023-03-14 14:55:58,918 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1678805726774.67d879ca35c5695ef1b3dd5a65dac816. after waiting 0 ms 2023-03-14 14:55:58,918 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1678805726774.67d879ca35c5695ef1b3dd5a65dac816. 2023-03-14 14:55:58,918 INFO [RS:0;jenkins-hbase20:41317] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-03-14 14:55:58,918 INFO [RS:0;jenkins-hbase20:41317] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-03-14 14:55:58,918 INFO [RS:0;jenkins-hbase20:41317] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-03-14 14:55:58,918 INFO [RS:0;jenkins-hbase20:41317] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-03-14 14:55:58,924 INFO [RS:0;jenkins-hbase20:41317] regionserver.HRegionServer(1475): Waiting on 21 regions to close 2023-03-14 14:55:58,926 DEBUG [RS:0;jenkins-hbase20:41317] regionserver.HRegionServer(1505): Waiting on 0b22b7f42a887fbc05e1153fe076072e, 10546b400d27bbc83495bff794d39660, 14e9cbacd99b2cc16b477e8d2c9c88a4, 1588230740, 1b57993c9af4fc1b678650e0db6b7634, 3b6ac335f3eded6c9d62899b5ba0c2df, 3ea13ff804537f3e856a240e0067a94c, 46b57114435577599b693b836e0ad8d2, 4e01724a8ecff4aa30dbfa9d68c1991a, 4fc16beb64e446f8e20e521dacdaf408, 541dfbe822716da662f3a573a64aa05f, 67d879ca35c5695ef1b3dd5a65dac816, 7eb84d1cb8ce303dd656f6348c25f0e3, 81d1d1d671b72bf2cfae45402ba07d68, 82c61abd947e5b78a8c268e9c5cab198, 8816b1e503374db245dbd0800d77f3a4, 97b71e93d23ff8810dbd42b157c10dd3, 984e5359c7c1d404d5a6dab33d5d90f1, b108573ed4edc7c6723ae22ab3b01c14, cfc8b82e17760331b0d59f661140bb28, d03921af574c9e368e124258e08ab95d 2023-03-14 14:55:58,927 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-03-14 14:55:58,927 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-03-14 14:55:58,927 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-03-14 14:55:58,927 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-03-14 14:55:58,928 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-03-14 14:55:58,928 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=50.62 KB heapSize=78.23 KB 2023-03-14 14:55:58,950 INFO [regionserver/jenkins-hbase20:0.Chore.2] hbase.ScheduledChore(146): Chore: CompactedHFilesCleaner was stopped 2023-03-14 14:55:58,960 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithMonthlyPolicy/67d879ca35c5695ef1b3dd5a65dac816/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-03-14 14:55:58,962 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1678805726774.67d879ca35c5695ef1b3dd5a65dac816. 2023-03-14 14:55:58,962 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 67d879ca35c5695ef1b3dd5a65dac816: 2023-03-14 14:55:58,962 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithMonthlyPolicy,,1678805726774.67d879ca35c5695ef1b3dd5a65dac816. 2023-03-14 14:55:58,962 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 10546b400d27bbc83495bff794d39660, disabling compactions & flushes 2023-03-14 14:55:58,962 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1678805584403.10546b400d27bbc83495bff794d39660. 2023-03-14 14:55:58,962 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1678805584403.10546b400d27bbc83495bff794d39660. 2023-03-14 14:55:58,962 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1678805584403.10546b400d27bbc83495bff794d39660. after waiting 0 ms 2023-03-14 14:55:58,962 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1678805584403.10546b400d27bbc83495bff794d39660. 2023-03-14 14:55:58,962 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 10546b400d27bbc83495bff794d39660 1/1 column families, dataSize=109 B heapSize=592 B 2023-03-14 14:55:59,008 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-03-14 14:55:59,127 DEBUG [RS:0;jenkins-hbase20:41317] regionserver.HRegionServer(1505): Waiting on 0b22b7f42a887fbc05e1153fe076072e, 10546b400d27bbc83495bff794d39660, 14e9cbacd99b2cc16b477e8d2c9c88a4, 1588230740, 1b57993c9af4fc1b678650e0db6b7634, 3b6ac335f3eded6c9d62899b5ba0c2df, 3ea13ff804537f3e856a240e0067a94c, 46b57114435577599b693b836e0ad8d2, 4e01724a8ecff4aa30dbfa9d68c1991a, 4fc16beb64e446f8e20e521dacdaf408, 541dfbe822716da662f3a573a64aa05f, 7eb84d1cb8ce303dd656f6348c25f0e3, 81d1d1d671b72bf2cfae45402ba07d68, 82c61abd947e5b78a8c268e9c5cab198, 8816b1e503374db245dbd0800d77f3a4, 97b71e93d23ff8810dbd42b157c10dd3, 984e5359c7c1d404d5a6dab33d5d90f1, b108573ed4edc7c6723ae22ab3b01c14, cfc8b82e17760331b0d59f661140bb28, d03921af574c9e368e124258e08ab95d 2023-03-14 14:55:59,327 DEBUG [RS:0;jenkins-hbase20:41317] regionserver.HRegionServer(1505): Waiting on 0b22b7f42a887fbc05e1153fe076072e, 10546b400d27bbc83495bff794d39660, 14e9cbacd99b2cc16b477e8d2c9c88a4, 1588230740, 1b57993c9af4fc1b678650e0db6b7634, 3b6ac335f3eded6c9d62899b5ba0c2df, 3ea13ff804537f3e856a240e0067a94c, 46b57114435577599b693b836e0ad8d2, 4e01724a8ecff4aa30dbfa9d68c1991a, 4fc16beb64e446f8e20e521dacdaf408, 541dfbe822716da662f3a573a64aa05f, 7eb84d1cb8ce303dd656f6348c25f0e3, 81d1d1d671b72bf2cfae45402ba07d68, 82c61abd947e5b78a8c268e9c5cab198, 8816b1e503374db245dbd0800d77f3a4, 97b71e93d23ff8810dbd42b157c10dd3, 984e5359c7c1d404d5a6dab33d5d90f1, b108573ed4edc7c6723ae22ab3b01c14, cfc8b82e17760331b0d59f661140bb28, d03921af574c9e368e124258e08ab95d 2023-03-14 14:55:59,366 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=48.34 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/hbase/meta/1588230740/.tmp/info/a0e18977ed6c48ce96d47152a06710bc 2023-03-14 14:55:59,372 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a0e18977ed6c48ce96d47152a06710bc 2023-03-14 14:55:59,388 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=109 B at sequenceid=7 (bloomFilter=true), to=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/hbase/namespace/10546b400d27bbc83495bff794d39660/.tmp/info/22cbedc488aa45628c279aa5792cf58d 2023-03-14 14:55:59,392 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/hbase/namespace/10546b400d27bbc83495bff794d39660/.tmp/info/22cbedc488aa45628c279aa5792cf58d as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/hbase/namespace/10546b400d27bbc83495bff794d39660/info/22cbedc488aa45628c279aa5792cf58d 2023-03-14 14:55:59,396 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/hbase/namespace/10546b400d27bbc83495bff794d39660/info/22cbedc488aa45628c279aa5792cf58d, entries=3, sequenceid=7, filesize=4.8 K 2023-03-14 14:55:59,397 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~109 B/109, heapSize ~576 B/576, currentSize=0 B/0 for 10546b400d27bbc83495bff794d39660 in 435ms, sequenceid=7, compaction requested=false 2023-03-14 14:55:59,401 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/hbase/namespace/10546b400d27bbc83495bff794d39660/recovered.edits/10.seqid, newMaxSeqId=10, maxSeqId=1 2023-03-14 14:55:59,402 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1678805584403.10546b400d27bbc83495bff794d39660. 2023-03-14 14:55:59,402 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 10546b400d27bbc83495bff794d39660: 2023-03-14 14:55:59,402 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1678805584403.10546b400d27bbc83495bff794d39660. 2023-03-14 14:55:59,402 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 82c61abd947e5b78a8c268e9c5cab198, disabling compactions & flushes 2023-03-14 14:55:59,402 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1678805739734.82c61abd947e5b78a8c268e9c5cab198. 2023-03-14 14:55:59,403 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1678805739734.82c61abd947e5b78a8c268e9c5cab198. 2023-03-14 14:55:59,403 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1678805739734.82c61abd947e5b78a8c268e9c5cab198. after waiting 0 ms 2023-03-14 14:55:59,403 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1678805739734.82c61abd947e5b78a8c268e9c5cab198. 2023-03-14 14:55:59,406 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/82c61abd947e5b78a8c268e9c5cab198/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-03-14 14:55:59,407 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1678805739734.82c61abd947e5b78a8c268e9c5cab198. 2023-03-14 14:55:59,407 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 82c61abd947e5b78a8c268e9c5cab198: 2023-03-14 14:55:59,408 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,,1678805739734.82c61abd947e5b78a8c268e9c5cab198. 2023-03-14 14:55:59,408 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 3ea13ff804537f3e856a240e0067a94c, disabling compactions & flushes 2023-03-14 14:55:59,408 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1678805627002.3ea13ff804537f3e856a240e0067a94c. 2023-03-14 14:55:59,408 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1678805627002.3ea13ff804537f3e856a240e0067a94c. 2023-03-14 14:55:59,408 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1678805627002.3ea13ff804537f3e856a240e0067a94c. after waiting 0 ms 2023-03-14 14:55:59,408 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1678805627002.3ea13ff804537f3e856a240e0067a94c. 2023-03-14 14:55:59,411 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testScannerOnBulkLoadRefHFiles/3ea13ff804537f3e856a240e0067a94c/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-03-14 14:55:59,412 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1678805627002.3ea13ff804537f3e856a240e0067a94c. 2023-03-14 14:55:59,412 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 3ea13ff804537f3e856a240e0067a94c: 2023-03-14 14:55:59,412 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,,1678805627002.3ea13ff804537f3e856a240e0067a94c. 2023-03-14 14:55:59,412 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 8816b1e503374db245dbd0800d77f3a4, disabling compactions & flushes 2023-03-14 14:55:59,412 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1678805739734.8816b1e503374db245dbd0800d77f3a4. 2023-03-14 14:55:59,412 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1678805739734.8816b1e503374db245dbd0800d77f3a4. 2023-03-14 14:55:59,412 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1678805739734.8816b1e503374db245dbd0800d77f3a4. after waiting 0 ms 2023-03-14 14:55:59,412 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1678805739734.8816b1e503374db245dbd0800d77f3a4. 2023-03-14 14:55:59,417 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/8816b1e503374db245dbd0800d77f3a4/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-03-14 14:55:59,418 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1678805739734.8816b1e503374db245dbd0800d77f3a4. 2023-03-14 14:55:59,418 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 8816b1e503374db245dbd0800d77f3a4: 2023-03-14 14:55:59,418 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,2,1678805739734.8816b1e503374db245dbd0800d77f3a4. 2023-03-14 14:55:59,419 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing d03921af574c9e368e124258e08ab95d, disabling compactions & flushes 2023-03-14 14:55:59,419 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1678805683037.d03921af574c9e368e124258e08ab95d. 2023-03-14 14:55:59,419 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1678805683037.d03921af574c9e368e124258e08ab95d. 2023-03-14 14:55:59,419 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1678805683037.d03921af574c9e368e124258e08ab95d. after waiting 0 ms 2023-03-14 14:55:59,419 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1678805683037.d03921af574c9e368e124258e08ab95d. 2023-03-14 14:55:59,423 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/d03921af574c9e368e124258e08ab95d/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-03-14 14:55:59,424 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1678805683037.d03921af574c9e368e124258e08ab95d. 2023-03-14 14:55:59,424 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for d03921af574c9e368e124258e08ab95d: 2023-03-14 14:55:59,424 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,2,1678805683037.d03921af574c9e368e124258e08ab95d. 2023-03-14 14:55:59,424 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 46b57114435577599b693b836e0ad8d2, disabling compactions & flushes 2023-03-14 14:55:59,424 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1678805683037.46b57114435577599b693b836e0ad8d2. 2023-03-14 14:55:59,424 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1678805683037.46b57114435577599b693b836e0ad8d2. 2023-03-14 14:55:59,424 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1678805683037.46b57114435577599b693b836e0ad8d2. after waiting 0 ms 2023-03-14 14:55:59,424 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1678805683037.46b57114435577599b693b836e0ad8d2. 2023-03-14 14:55:59,428 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/46b57114435577599b693b836e0ad8d2/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-03-14 14:55:59,429 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1678805683037.46b57114435577599b693b836e0ad8d2. 2023-03-14 14:55:59,429 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 46b57114435577599b693b836e0ad8d2: 2023-03-14 14:55:59,429 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,1,1678805683037.46b57114435577599b693b836e0ad8d2. 2023-03-14 14:55:59,429 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-03-14 14:55:59,429 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 984e5359c7c1d404d5a6dab33d5d90f1, disabling compactions & flushes 2023-03-14 14:55:59,429 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-03-14 14:55:59,429 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1678805613006.984e5359c7c1d404d5a6dab33d5d90f1. 2023-03-14 14:55:59,430 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1678805613006.984e5359c7c1d404d5a6dab33d5d90f1. 2023-03-14 14:55:59,430 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1678805613006.984e5359c7c1d404d5a6dab33d5d90f1. after waiting 0 ms 2023-03-14 14:55:59,430 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1678805613006.984e5359c7c1d404d5a6dab33d5d90f1. 2023-03-14 14:55:59,434 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMinorCompactionWithWeeklyPolicy/984e5359c7c1d404d5a6dab33d5d90f1/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-03-14 14:55:59,435 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1678805613006.984e5359c7c1d404d5a6dab33d5d90f1. 2023-03-14 14:55:59,435 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 984e5359c7c1d404d5a6dab33d5d90f1: 2023-03-14 14:55:59,435 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithWeeklyPolicy,,1678805613006.984e5359c7c1d404d5a6dab33d5d90f1. 2023-03-14 14:55:59,435 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 4fc16beb64e446f8e20e521dacdaf408, disabling compactions & flushes 2023-03-14 14:55:59,435 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1678805627002.4fc16beb64e446f8e20e521dacdaf408. 2023-03-14 14:55:59,435 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1678805627002.4fc16beb64e446f8e20e521dacdaf408. 2023-03-14 14:55:59,435 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1678805627002.4fc16beb64e446f8e20e521dacdaf408. after waiting 0 ms 2023-03-14 14:55:59,435 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1678805627002.4fc16beb64e446f8e20e521dacdaf408. 2023-03-14 14:55:59,437 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testScannerOnBulkLoadRefHFiles/4fc16beb64e446f8e20e521dacdaf408/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-03-14 14:55:59,438 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1678805627002.4fc16beb64e446f8e20e521dacdaf408. 2023-03-14 14:55:59,438 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 4fc16beb64e446f8e20e521dacdaf408: 2023-03-14 14:55:59,438 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,2,1678805627002.4fc16beb64e446f8e20e521dacdaf408. 2023-03-14 14:55:59,438 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 4e01724a8ecff4aa30dbfa9d68c1991a, disabling compactions & flushes 2023-03-14 14:55:59,438 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a. 2023-03-14 14:55:59,438 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a. 2023-03-14 14:55:59,438 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a. after waiting 0 ms 2023-03-14 14:55:59,438 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a. 2023-03-14 14:55:59,441 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/4e01724a8ecff4aa30dbfa9d68c1991a/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-03-14 14:55:59,441 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a. 2023-03-14 14:55:59,441 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 4e01724a8ecff4aa30dbfa9d68c1991a: 2023-03-14 14:55:59,442 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1678805660792.4e01724a8ecff4aa30dbfa9d68c1991a. 2023-03-14 14:55:59,442 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 1b57993c9af4fc1b678650e0db6b7634, disabling compactions & flushes 2023-03-14 14:55:59,442 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1678805709571.1b57993c9af4fc1b678650e0db6b7634. 2023-03-14 14:55:59,442 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1678805709571.1b57993c9af4fc1b678650e0db6b7634. 2023-03-14 14:55:59,442 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1678805709571.1b57993c9af4fc1b678650e0db6b7634. after waiting 0 ms 2023-03-14 14:55:59,442 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1678805709571.1b57993c9af4fc1b678650e0db6b7634. 2023-03-14 14:55:59,444 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/1b57993c9af4fc1b678650e0db6b7634/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-03-14 14:55:59,445 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1678805709571.1b57993c9af4fc1b678650e0db6b7634. 2023-03-14 14:55:59,445 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 1b57993c9af4fc1b678650e0db6b7634: 2023-03-14 14:55:59,445 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,2,1678805709571.1b57993c9af4fc1b678650e0db6b7634. 2023-03-14 14:55:59,445 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 3b6ac335f3eded6c9d62899b5ba0c2df, disabling compactions & flushes 2023-03-14 14:55:59,445 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1678805631334.3b6ac335f3eded6c9d62899b5ba0c2df. 2023-03-14 14:55:59,445 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1678805631334.3b6ac335f3eded6c9d62899b5ba0c2df. 2023-03-14 14:55:59,445 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1678805631334.3b6ac335f3eded6c9d62899b5ba0c2df. after waiting 0 ms 2023-03-14 14:55:59,445 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1678805631334.3b6ac335f3eded6c9d62899b5ba0c2df. 2023-03-14 14:55:59,448 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyPolicy/3b6ac335f3eded6c9d62899b5ba0c2df/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-03-14 14:55:59,448 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1678805631334.3b6ac335f3eded6c9d62899b5ba0c2df. 2023-03-14 14:55:59,448 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 3b6ac335f3eded6c9d62899b5ba0c2df: 2023-03-14 14:55:59,449 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyPolicy,,1678805631334.3b6ac335f3eded6c9d62899b5ba0c2df. 2023-03-14 14:55:59,449 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 7eb84d1cb8ce303dd656f6348c25f0e3, disabling compactions & flushes 2023-03-14 14:55:59,449 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1678805627002.7eb84d1cb8ce303dd656f6348c25f0e3. 2023-03-14 14:55:59,449 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1678805627002.7eb84d1cb8ce303dd656f6348c25f0e3. 2023-03-14 14:55:59,449 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1678805627002.7eb84d1cb8ce303dd656f6348c25f0e3. after waiting 0 ms 2023-03-14 14:55:59,449 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1678805627002.7eb84d1cb8ce303dd656f6348c25f0e3. 2023-03-14 14:55:59,450 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testScannerOnBulkLoadRefHFiles/7eb84d1cb8ce303dd656f6348c25f0e3/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-03-14 14:55:59,452 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1678805627002.7eb84d1cb8ce303dd656f6348c25f0e3. 2023-03-14 14:55:59,452 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 7eb84d1cb8ce303dd656f6348c25f0e3: 2023-03-14 14:55:59,452 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,1,1678805627002.7eb84d1cb8ce303dd656f6348c25f0e3. 2023-03-14 14:55:59,452 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 14e9cbacd99b2cc16b477e8d2c9c88a4, disabling compactions & flushes 2023-03-14 14:55:59,452 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1678805709571.14e9cbacd99b2cc16b477e8d2c9c88a4. 2023-03-14 14:55:59,452 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1678805709571.14e9cbacd99b2cc16b477e8d2c9c88a4. 2023-03-14 14:55:59,452 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1678805709571.14e9cbacd99b2cc16b477e8d2c9c88a4. after waiting 0 ms 2023-03-14 14:55:59,452 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1678805709571.14e9cbacd99b2cc16b477e8d2c9c88a4. 2023-03-14 14:55:59,455 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/14e9cbacd99b2cc16b477e8d2c9c88a4/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-03-14 14:55:59,455 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1678805709571.14e9cbacd99b2cc16b477e8d2c9c88a4. 2023-03-14 14:55:59,455 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 14e9cbacd99b2cc16b477e8d2c9c88a4: 2023-03-14 14:55:59,455 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,1,1678805709571.14e9cbacd99b2cc16b477e8d2c9c88a4. 2023-03-14 14:55:59,455 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 541dfbe822716da662f3a573a64aa05f, disabling compactions & flushes 2023-03-14 14:55:59,455 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1678805683037.541dfbe822716da662f3a573a64aa05f. 2023-03-14 14:55:59,455 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1678805683037.541dfbe822716da662f3a573a64aa05f. 2023-03-14 14:55:59,455 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1678805683037.541dfbe822716da662f3a573a64aa05f. after waiting 0 ms 2023-03-14 14:55:59,455 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1678805683037.541dfbe822716da662f3a573a64aa05f. 2023-03-14 14:55:59,458 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testCompactionWithHFileLink/541dfbe822716da662f3a573a64aa05f/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-03-14 14:55:59,458 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1678805683037.541dfbe822716da662f3a573a64aa05f. 2023-03-14 14:55:59,458 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 541dfbe822716da662f3a573a64aa05f: 2023-03-14 14:55:59,458 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,,1678805683037.541dfbe822716da662f3a573a64aa05f. 2023-03-14 14:55:59,458 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing b108573ed4edc7c6723ae22ab3b01c14, disabling compactions & flushes 2023-03-14 14:55:59,458 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14. 2023-03-14 14:55:59,458 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14. 2023-03-14 14:55:59,458 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14. after waiting 0 ms 2023-03-14 14:55:59,458 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14. 2023-03-14 14:55:59,461 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/b108573ed4edc7c6723ae22ab3b01c14/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-03-14 14:55:59,461 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14. 2023-03-14 14:55:59,461 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for b108573ed4edc7c6723ae22ab3b01c14: 2023-03-14 14:55:59,461 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1678805644012.b108573ed4edc7c6723ae22ab3b01c14. 2023-03-14 14:55:59,462 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 0b22b7f42a887fbc05e1153fe076072e, disabling compactions & flushes 2023-03-14 14:55:59,462 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1678805586057.0b22b7f42a887fbc05e1153fe076072e. 2023-03-14 14:55:59,462 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1678805586057.0b22b7f42a887fbc05e1153fe076072e. 2023-03-14 14:55:59,462 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1678805586057.0b22b7f42a887fbc05e1153fe076072e. after waiting 0 ms 2023-03-14 14:55:59,462 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1678805586057.0b22b7f42a887fbc05e1153fe076072e. 2023-03-14 14:55:59,464 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/0b22b7f42a887fbc05e1153fe076072e/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-03-14 14:55:59,465 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1678805586057.0b22b7f42a887fbc05e1153fe076072e. 2023-03-14 14:55:59,465 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 0b22b7f42a887fbc05e1153fe076072e: 2023-03-14 14:55:59,465 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1678805586057.0b22b7f42a887fbc05e1153fe076072e. 2023-03-14 14:55:59,465 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 97b71e93d23ff8810dbd42b157c10dd3, disabling compactions & flushes 2023-03-14 14:55:59,465 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1678805599570.97b71e93d23ff8810dbd42b157c10dd3. 2023-03-14 14:55:59,465 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1678805599570.97b71e93d23ff8810dbd42b157c10dd3. 2023-03-14 14:55:59,465 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1678805599570.97b71e93d23ff8810dbd42b157c10dd3. after waiting 0 ms 2023-03-14 14:55:59,465 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1678805599570.97b71e93d23ff8810dbd42b157c10dd3. 2023-03-14 14:55:59,468 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionWithMonthlyPolicy/97b71e93d23ff8810dbd42b157c10dd3/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-03-14 14:55:59,468 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1678805599570.97b71e93d23ff8810dbd42b157c10dd3. 2023-03-14 14:55:59,468 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 97b71e93d23ff8810dbd42b157c10dd3: 2023-03-14 14:55:59,468 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithMonthlyPolicy,,1678805599570.97b71e93d23ff8810dbd42b157c10dd3. 2023-03-14 14:55:59,468 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 81d1d1d671b72bf2cfae45402ba07d68, disabling compactions & flushes 2023-03-14 14:55:59,468 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1678805709571.81d1d1d671b72bf2cfae45402ba07d68. 2023-03-14 14:55:59,469 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1678805709571.81d1d1d671b72bf2cfae45402ba07d68. 2023-03-14 14:55:59,469 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1678805709571.81d1d1d671b72bf2cfae45402ba07d68. after waiting 0 ms 2023-03-14 14:55:59,469 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1678805709571.81d1d1d671b72bf2cfae45402ba07d68. 2023-03-14 14:55:59,476 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/ns/testMinorCompaction/81d1d1d671b72bf2cfae45402ba07d68/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-03-14 14:55:59,477 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1678805709571.81d1d1d671b72bf2cfae45402ba07d68. 2023-03-14 14:55:59,477 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 81d1d1d671b72bf2cfae45402ba07d68: 2023-03-14 14:55:59,477 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,,1678805709571.81d1d1d671b72bf2cfae45402ba07d68. 2023-03-14 14:55:59,477 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing cfc8b82e17760331b0d59f661140bb28, disabling compactions & flushes 2023-03-14 14:55:59,477 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1678805739734.cfc8b82e17760331b0d59f661140bb28. 2023-03-14 14:55:59,477 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1678805739734.cfc8b82e17760331b0d59f661140bb28. 2023-03-14 14:55:59,477 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1678805739734.cfc8b82e17760331b0d59f661140bb28. after waiting 0 ms 2023-03-14 14:55:59,477 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1678805739734.cfc8b82e17760331b0d59f661140bb28. 2023-03-14 14:55:59,480 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/default/testMajorCompactionFromAdmin/cfc8b82e17760331b0d59f661140bb28/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-03-14 14:55:59,480 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1678805739734.cfc8b82e17760331b0d59f661140bb28. 2023-03-14 14:55:59,480 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for cfc8b82e17760331b0d59f661140bb28: 2023-03-14 14:55:59,480 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,1,1678805739734.cfc8b82e17760331b0d59f661140bb28. 2023-03-14 14:55:59,528 DEBUG [RS:0;jenkins-hbase20:41317] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-03-14 14:55:59,728 DEBUG [RS:0;jenkins-hbase20:41317] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-03-14 14:55:59,778 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=102 B at sequenceid=130 (bloomFilter=false), to=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/hbase/meta/1588230740/.tmp/rep_barrier/0ada979506ed4dd1a915f75b12d189c4 2023-03-14 14:55:59,783 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0ada979506ed4dd1a915f75b12d189c4 2023-03-14 14:55:59,924 DEBUG [regionserver/jenkins-hbase20:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-03-14 14:55:59,928 INFO [RS:0;jenkins-hbase20:41317] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-03-14 14:55:59,928 DEBUG [RS:0;jenkins-hbase20:41317] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-03-14 14:55:59,928 DEBUG [RS:0;jenkins-hbase20:41317] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-03-14 14:56:00,128 DEBUG [RS:0;jenkins-hbase20:41317] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-03-14 14:56:00,197 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.18 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/hbase/meta/1588230740/.tmp/table/9c7bd143eb654599ad30c4835568c22e 2023-03-14 14:56:00,206 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9c7bd143eb654599ad30c4835568c22e 2023-03-14 14:56:00,207 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/hbase/meta/1588230740/.tmp/info/a0e18977ed6c48ce96d47152a06710bc as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/hbase/meta/1588230740/info/a0e18977ed6c48ce96d47152a06710bc 2023-03-14 14:56:00,211 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a0e18977ed6c48ce96d47152a06710bc 2023-03-14 14:56:00,211 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/hbase/meta/1588230740/info/a0e18977ed6c48ce96d47152a06710bc, entries=226, sequenceid=130, filesize=37.9 K 2023-03-14 14:56:00,212 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/hbase/meta/1588230740/.tmp/rep_barrier/0ada979506ed4dd1a915f75b12d189c4 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/hbase/meta/1588230740/rep_barrier/0ada979506ed4dd1a915f75b12d189c4 2023-03-14 14:56:00,216 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0ada979506ed4dd1a915f75b12d189c4 2023-03-14 14:56:00,216 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/hbase/meta/1588230740/rep_barrier/0ada979506ed4dd1a915f75b12d189c4, entries=1, sequenceid=130, filesize=5.0 K 2023-03-14 14:56:00,217 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/hbase/meta/1588230740/.tmp/table/9c7bd143eb654599ad30c4835568c22e as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/hbase/meta/1588230740/table/9c7bd143eb654599ad30c4835568c22e 2023-03-14 14:56:00,221 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9c7bd143eb654599ad30c4835568c22e 2023-03-14 14:56:00,221 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/hbase/meta/1588230740/table/9c7bd143eb654599ad30c4835568c22e, entries=27, sequenceid=130, filesize=6.6 K 2023-03-14 14:56:00,223 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~50.62 KB/51839, heapSize ~78.19 KB/80064, currentSize=0 B/0 for 1588230740 in 1295ms, sequenceid=130, compaction requested=false 2023-03-14 14:56:00,233 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/data/hbase/meta/1588230740/recovered.edits/133.seqid, newMaxSeqId=133, maxSeqId=1 2023-03-14 14:56:00,234 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-03-14 14:56:00,234 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-03-14 14:56:00,234 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-03-14 14:56:00,234 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-03-14 14:56:00,329 INFO [RS:0;jenkins-hbase20:41317] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,41317,1678805580877; all regions closed. 2023-03-14 14:56:00,337 DEBUG [RS:0;jenkins-hbase20:41317] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/oldWALs 2023-03-14 14:56:00,338 INFO [RS:0;jenkins-hbase20:41317] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C41317%2C1678805580877.meta:.meta(num 1678805584149) 2023-03-14 14:56:00,343 DEBUG [RS:0;jenkins-hbase20:41317] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/oldWALs 2023-03-14 14:56:00,343 INFO [RS:0;jenkins-hbase20:41317] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C41317%2C1678805580877:(num 1678805583556) 2023-03-14 14:56:00,343 DEBUG [RS:0;jenkins-hbase20:41317] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-14 14:56:00,343 INFO [RS:0;jenkins-hbase20:41317] regionserver.LeaseManager(133): Closed leases 2023-03-14 14:56:00,343 INFO [RS:0;jenkins-hbase20:41317] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-03-14 14:56:00,344 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-03-14 14:56:00,345 INFO [RS:0;jenkins-hbase20:41317] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:41317 2023-03-14 14:56:00,354 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-03-14 14:56:00,355 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,41317,1678805580877 2023-03-14 14:56:00,355 ERROR [Listener at localhost.localdomain/44261-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@25208cd9 rejected from java.util.concurrent.ThreadPoolExecutor@211f1ca5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 532] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-03-14 14:56:00,355 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,41317,1678805580877] 2023-03-14 14:56:00,355 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-03-14 14:56:00,356 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,41317,1678805580877; numProcessing=1 2023-03-14 14:56:00,356 ERROR [Listener at localhost.localdomain/44261-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@74541c6b rejected from java.util.concurrent.ThreadPoolExecutor@211f1ca5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 532] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-03-14 14:56:00,357 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,41317,1678805580877 already deleted, retry=false 2023-03-14 14:56:00,357 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,41317,1678805580877 expired; onlineServers=0 2023-03-14 14:56:00,357 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,38031,1678805579674' ***** 2023-03-14 14:56:00,357 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-03-14 14:56:00,358 DEBUG [M:0;jenkins-hbase20:38031] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@32d38011, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-03-14 14:56:00,358 INFO [M:0;jenkins-hbase20:38031] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,38031,1678805579674 2023-03-14 14:56:00,358 INFO [M:0;jenkins-hbase20:38031] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,38031,1678805579674; all regions closed. 2023-03-14 14:56:00,358 DEBUG [M:0;jenkins-hbase20:38031] ipc.AbstractRpcClient(494): Stopping rpc client 2023-03-14 14:56:00,358 DEBUG [M:0;jenkins-hbase20:38031] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-03-14 14:56:00,358 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-03-14 14:56:00,358 DEBUG [M:0;jenkins-hbase20:38031] cleaner.HFileCleaner(317): Stopping file delete threads 2023-03-14 14:56:00,358 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1678805583300] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1678805583300,5,FailOnTimeoutGroup] 2023-03-14 14:56:00,358 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1678805583297] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1678805583297,5,FailOnTimeoutGroup] 2023-03-14 14:56:00,359 INFO [M:0;jenkins-hbase20:38031] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-03-14 14:56:00,359 INFO [M:0;jenkins-hbase20:38031] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-03-14 14:56:00,359 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-03-14 14:56:00,359 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-03-14 14:56:00,359 INFO [M:0;jenkins-hbase20:38031] hbase.ChoreService(369): Chore service for: master/jenkins-hbase20:0 had [] on shutdown 2023-03-14 14:56:00,359 DEBUG [M:0;jenkins-hbase20:38031] master.HMaster(1512): Stopping service threads 2023-03-14 14:56:00,359 INFO [M:0;jenkins-hbase20:38031] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-03-14 14:56:00,360 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-03-14 14:56:00,360 ERROR [M:0;jenkins-hbase20:38031] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-20,5,PEWorkerGroup] Thread[HFileArchiver-21,5,PEWorkerGroup] Thread[HFileArchiver-22,5,PEWorkerGroup] 2023-03-14 14:56:00,361 INFO [M:0;jenkins-hbase20:38031] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-03-14 14:56:00,361 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-03-14 14:56:00,362 DEBUG [M:0;jenkins-hbase20:38031] zookeeper.ZKUtil(398): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-03-14 14:56:00,362 WARN [M:0;jenkins-hbase20:38031] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-03-14 14:56:00,362 INFO [M:0;jenkins-hbase20:38031] assignment.AssignmentManager(315): Stopping assignment manager 2023-03-14 14:56:00,362 INFO [M:0;jenkins-hbase20:38031] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-03-14 14:56:00,362 DEBUG [M:0;jenkins-hbase20:38031] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-03-14 14:56:00,362 INFO [M:0;jenkins-hbase20:38031] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-14 14:56:00,362 DEBUG [M:0;jenkins-hbase20:38031] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-14 14:56:00,362 DEBUG [M:0;jenkins-hbase20:38031] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-03-14 14:56:00,362 DEBUG [M:0;jenkins-hbase20:38031] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-14 14:56:00,362 INFO [M:0;jenkins-hbase20:38031] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=513.35 KB heapSize=599.13 KB 2023-03-14 14:56:00,383 INFO [M:0;jenkins-hbase20:38031] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=513.35 KB at sequenceid=1005 (bloomFilter=true), to=hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/f3e423475edb4abd907a553b2c27fc64 2023-03-14 14:56:00,387 INFO [M:0;jenkins-hbase20:38031] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f3e423475edb4abd907a553b2c27fc64 2023-03-14 14:56:00,388 DEBUG [M:0;jenkins-hbase20:38031] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/f3e423475edb4abd907a553b2c27fc64 as hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/f3e423475edb4abd907a553b2c27fc64 2023-03-14 14:56:00,392 INFO [M:0;jenkins-hbase20:38031] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f3e423475edb4abd907a553b2c27fc64 2023-03-14 14:56:00,392 INFO [M:0;jenkins-hbase20:38031] regionserver.HStore(1080): Added hdfs://localhost.localdomain:33945/user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/f3e423475edb4abd907a553b2c27fc64, entries=123, sequenceid=1005, filesize=33.3 K 2023-03-14 14:56:00,393 INFO [M:0;jenkins-hbase20:38031] regionserver.HRegion(2948): Finished flush of dataSize ~513.35 KB/525668, heapSize ~599.12 KB/613496, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 31ms, sequenceid=1005, compaction requested=false 2023-03-14 14:56:00,394 INFO [M:0;jenkins-hbase20:38031] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-03-14 14:56:00,394 DEBUG [M:0;jenkins-hbase20:38031] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-03-14 14:56:00,397 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/eefae749-a006-7815-1794-847570a81fdd/MasterData/WALs/jenkins-hbase20.apache.org,38031,1678805579674/jenkins-hbase20.apache.org%2C38031%2C1678805579674.1678805582571 not finished, retry = 0 2023-03-14 14:56:00,457 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-03-14 14:56:00,457 INFO [RS:0;jenkins-hbase20:41317] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,41317,1678805580877; zookeeper connection closed. 2023-03-14 14:56:00,457 ERROR [Listener at localhost.localdomain/44261-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@c10c45b rejected from java.util.concurrent.ThreadPoolExecutor@211f1ca5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 532] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-03-14 14:56:00,457 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): regionserver:41317-0x10010524c470001, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-03-14 14:56:00,457 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@62935312] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@62935312 2023-03-14 14:56:00,457 ERROR [Listener at localhost.localdomain/44261-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@50d18a04 rejected from java.util.concurrent.ThreadPoolExecutor@211f1ca5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 532] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-03-14 14:56:00,457 INFO [Listener at localhost.localdomain/44261] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-03-14 14:56:00,498 INFO [M:0;jenkins-hbase20:38031] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-03-14 14:56:00,498 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-03-14 14:56:00,499 INFO [M:0;jenkins-hbase20:38031] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:38031 2023-03-14 14:56:00,501 DEBUG [M:0;jenkins-hbase20:38031] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase20.apache.org,38031,1678805579674 already deleted, retry=false 2023-03-14 14:56:00,601 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-03-14 14:56:00,601 INFO [M:0;jenkins-hbase20:38031] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,38031,1678805579674; zookeeper connection closed. 2023-03-14 14:56:00,601 ERROR [Listener at localhost.localdomain/44261-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6b70b55c rejected from java.util.concurrent.ThreadPoolExecutor@673435b1[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 906] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-03-14 14:56:00,602 DEBUG [Listener at localhost.localdomain/44261-EventThread] zookeeper.ZKWatcher(600): master:38031-0x10010524c470000, quorum=127.0.0.1:50211, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-03-14 14:56:00,602 ERROR [Listener at localhost.localdomain/44261-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@545b1c34 rejected from java.util.concurrent.ThreadPoolExecutor@673435b1[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 906] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-03-14 14:56:00,603 WARN [Listener at localhost.localdomain/44261] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-03-14 14:56:00,607 INFO [Listener at localhost.localdomain/44261] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-03-14 14:56:00,614 WARN [BP-280133883-148.251.75.209-1678805575875 heartbeating to localhost.localdomain/127.0.0.1:33945] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-03-14 14:56:00,614 WARN [BP-280133883-148.251.75.209-1678805575875 heartbeating to localhost.localdomain/127.0.0.1:33945] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-280133883-148.251.75.209-1678805575875 (Datanode Uuid 9781bc52-66f5-49e1-bb4e-a435e13d0b1c) service to localhost.localdomain/127.0.0.1:33945 2023-03-14 14:56:00,616 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/32713c79-3a0d-e28f-4850-1b932c385dc5/cluster_ea1a76c9-5fcc-f1b0-725a-f88680cff8ea/dfs/data/data1/current/BP-280133883-148.251.75.209-1678805575875] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-03-14 14:56:00,616 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/32713c79-3a0d-e28f-4850-1b932c385dc5/cluster_ea1a76c9-5fcc-f1b0-725a-f88680cff8ea/dfs/data/data2/current/BP-280133883-148.251.75.209-1678805575875] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-03-14 14:56:00,649 INFO [Listener at localhost.localdomain/44261] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:0 2023-03-14 14:56:00,780 INFO [Listener at localhost.localdomain/44261] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-03-14 14:56:00,876 INFO [Listener at localhost.localdomain/44261] hbase.HBaseTestingUtility(1293): Minicluster is down